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CONFIRMATION NO. 
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THE APPLICATION IDENTIFIED ABOVE HAS BEEN EXAMINED AND IS ALLOWED FOR ISSUANCE AS A PATEN 
PROSECUTION ON THE MERITS IS CLOSED . THIS NOTICE OF ALLOWANCE IS NOT A GRANT OF PATENT RIGHT 
THIS APPLICATION IS SUBJECT TO WITHDRAWAL FROM ISSUE AT THE INITIATIVE OF THE OFFICE OR UPO 
PETITION BY THE APPLICANT. SEE 37 CFR 1.313 AND MPEP 1308. 



THE ISSUE FEE AND PUBLICATION FEE (IF REQUIRED) MUST BE PAID WITHIN THREE MONTHS FROM TH 
MAILING DATE OF THIS NOTICE OR THIS APPLICATION SHALL BE REGARDED AS ABANDONED. TH 
STATUTORY PERIOD CANNOT BE EXTENDED . SEE 35 U.S.C. 151. THE ISSUE FEE DUE INDICATED ABOV 
REFLECTS A CREDIT FOR ANY PREVIOUSLY PAID ISSUE FEE APPLIED IN THIS APPLICATION. THE PTOL-85B (O 
AN EQUIVALENT) MUST BE RETURNED WITHIN THIS PERIOD EVEN IF NO FEE IS DUE OR THE APPLICATION WIL 
BE REGARDED AS ABANDONED. 

HOW TO REPLY TO THIS NOTICE: 

I. Review the SMALL ENTITY status shown above. 

If the SMALL ENTITY is shown as YES, verify your current 
SMALL ENTITY status: 

A. If the status is the same, pay the TOTAL FEE(S) DUE shown 
above. 

B. If the status above is to be removed, check box 5b on Part B - 
Fee(s) Transmittal and pay the PUBLICATION FEE (if required) 
and twice the amount of the ISSUE FEE shown above, or 



If the SMALL ENTITY is shown as NO: 

A. Pay TOTAL FEE(S) DUE shown above, or 

B. If applicant claimed SMALL ENTITY status before, or is n 
claiming SMALL ENTITY status, check box 5a on Part B - Fee 
Transmittal and pay the PUBLICATION FEE (if required) and 
the ISSUE FEE shown above. 



II. PART B - FEE(S) TRANSMITTAL should be completed and returned to the United States Patent and Trademark Office (USPTO) w 
your ISSUE FEE and PUBLICATION FEE (if required). Even if the fee(s) have already been paid, Part B - Fee(s) Transmittal should 
completed and returned. If you are charging the fee(s) to your deposit account, section "4b" of Part B - Fee(s) Transmittal should 
completed and an extra copy of the form should be submitted. 

III. All communications regarding this application must give the application number. Please direct all communications prior to issuance 
Mail Stop ISSUE FEE unless advised to the contrary. 

IMPORTANT REMINDER: Utility patents issuing on applications filed on or after Dec. 12, 1980 may require payment 
maintenance fees. It is patentee's responsibility to ensure timely payment of maintenance fees when due. 
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PART B - FEE(S) TRANSMITTAL 



Complete and send this form, together with applicable fee(s), to: Mail 



or Fax 



Mail Stop ISSUE FEE 
Commissioner for Patents 
P.O. Box 1450 

Alexandria, Virginia 22313-1450 
(703) 746-4000 



INSTRUCTIONS: This form should be used for transmitting the ISSUE FEE and PUBLICATION FEE (if required). Blocks 1 through 5 should be completed wh 
appropriate. All further correspondence including the Patent, advance orders and notification of maintenance fees will be mailed to the current correspondence address 
indicated unless corrected below or directed otherwise in Block 1, by (a) specifying a new correspondence address; and/or (b) indicating a separate "FEE ADDRESS" 
maintenance fee notifications. 



CURRENT CORRESPONDENCE ADDRESS (Note: Use Block I for any change of address) 



02292 



7590 



04/1 1/2005 



BIRCH STEWART KOLASCH & BIRCH 
PO BOX 747 

FALLS CHURCH, VA 22040-0747 



Note: A certificate of mailing can only be used for domestic mailings of 
Fee(s) Transmittal. This certificate cannot be used for any other accompany 
papers. Each additional paper, such as an assignment or formal drawing, m 
nave its own certificate of mailing or transmission. 

Certificate of Mailing or Transmission 
I hereby certify that this Fee(s) Transmittal is being deposited with the Un 
States Postal Service with sufficient postage for first class mail in an envel 
addressed to the Mail Stop ISSUE FEE address above, or being facsim 
transmitted to the USPTO (703) 746-4000, on the date indicated below. 



(Depositor's na 



(Signal 



(D 
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1. Change of correspondence address or indication of "Fee Address" (37 
CFR 1.J63). 

Q Change of correspondence address (or Change of Correspondence 
Address form PTO/SB/122) attached. 

□ "Fee Address" indication (or "Fee Address" Indication form 
PTO/SB/47; Rev 03-02 or more recent) attached. Use of a Customer 
Number is required. . 



2. For printing on the patent front page, list 

(1) the names of up to 3 registered patent attorneys 
or agents OR, alternatively, 

(2) the name of a single firm (having as a member a 
registered attorney or agent) and the names of up to 
2 registered patent attorneys or agents. If no name is 
listed, no name will be printed. 



3. ASSIGNEE NAME AND RESIDENCE DATA TO BE PRINTED ON THE PATENT (print or type) 

PLEASE NOTE: Unless an assignee is identified below, no assignee data will appear on the patent. If an assignee is identified below, the document has been filed 
recordation as set forth in 37 CFR 3. 1 1 . Completion of this form is NOT a substitute for filing an assignment. 



(A) NAME OF ASSIGNEE 



(B) RESIDENCE: (CITY and STATE OR COUNTRY) 



Please check the appropriate assignee category or categories (will not be printed on the patent) : Q Individual Q Corporation or other private group entity Q Governm 
4a. The following fee(s) are enclosed: 4b. Payment of Fee(s): 

□ Issue Fee Q A check in the amount of the fee(s) is enclosed. 
Publication Fee (No small entity discount permitted) Q Payment by credit card. Form PTO-2038 is attached. 

□ Advance Order - # of Copies The Director is hereby authorized by charge the required fee(s), or credit any overpayment 

Deposit Account Number (enclose an extra copy of this form). 

5. Change in Entity Status (from status indicated above) 

□ a. Applicant claims SMALL ENTITY status. See 37 CFR 1 .27. □ b. Applicant is no longer claiming SMALL ENTITY status. See 37 CFR 1 .27(g)(2). 

The Director of the USPTO is requested to apply the Issue Fee and Publication Fee (if any) or to re-apply any previously paid issue fee to the application identified above. 
NOTE: The Issue Fee and Publication Fee (if required) will not be accepted from anyone other than the applicant; a registered attorney or agent; or the assignee or other part 
interest as shown by the records of the United States Patent and Trademark Office. 

Authorized Signature Date 



Typed or printed name Registration No. . 



This collection of information is required by 37 CFR 1.311. The information is required to obtain or retain a benefit by the public which is to file (and by the USPTO to proc 
an application. Confidentiality is governed by 35 U.S.C. 122 and 37 CFR 1.14. This collection is estimated to take 12 minutes to complete, including gathering, preparing, 
submitting the completed application form to the USPTO. Time will vary depending upon the individual case. Any comments on the amount of time you require to comp 
this form and/or suggestions for reducing this burden, should be sent to the Chief Information Officer, U.S. Patent and Trademark Office, U.S. Department of Commerce, P 
Box 1450, Alexandria, Virginia 22313-1450. DO NOT SEND FEES OR COMPLETED FORMS TO THIS ADDRESS. SEND TO: Commissioner for Patents, P.O. Box 14 
Alexandria, Virginia 22313-1450. 

Under the Paperwork Reduction Act of 1995, no persons are required to respond to a collection of information unless it displays a valid OMB control number. 
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Determination of Patent Term Adjustment under 35 U.S.C. 154 (b) 

(application filed on or after May 29, 2000) 

The Patent Term Adjustment to date is 0 day(s). If the issue fee is paid on the date that is three months after t 
mailing date of this notice and the patent issues on the Tuesday before the date that is 28 weeks (six and a ha 
months) after the mailing date of this notice, the Patent Term Adjustment will be 0 day(s). 

If a Continued Prosecution Application (CPA) was filed in the above-identified application, the filing date th 
determines Patent Term Adjustment is the filing date of the most recent CPA. 

Applicant will be able to obtain more detailed information by accessing the Patent Application Information Retriev 
(PAIR) WEB site (http://pair.uspto.gov). 

Any questions regarding the Patent Term Extension or Adjustment determination should be directed to the Office 
Patent Legal Administration at (571) 272-7702. Questions relating to issue and publication fee payments should 
directed to the Customer Service Center of the Office of Patent Publication at (703) 305-8283. 
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Notice of Allowability 



Application No. 

10/829,193 



Examiner 



Lansana Nyalley 



Appticant(s) 

KIYOMORI ETAL 



Art Unit 



1621 



- The MAILING DATE of this communication appears on the cover sheet with the correspondence address- 
All claims being allowable, PROSECUTION ON THE MERITS IS (OR REMAINS) CLOSED in this application. If not included 
herewith (or previously mailed), a Notice of Allowance (PTOL-85) or other appropriate communication will be mailed in due course. THIS 
NOTICE OF ALLOWABILITY IS NOT A GRANT OF PATENT RIGHTS. This application is subject to withdrawal from issue at the initiative 
of the Office or upon petition by the applicant. See 37 CFR 1.313 and MPEP 1308. 

1 . ^ This communication is responsive to THE ARGUMENT FILED ON 01-1 &-2005 . 

2. [X] The allowed claim(s) is/are 1-5 and 7-15 . 

3. O The drawings filed on are accepted by the Examiner. 

4. S3 Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or(f). 

a) E3 All b) □ Some* c) □ None of the: 

1. ^ Certified copies of the priority documents have been received. 

2. □ Certified copies of the priority documents have been received in Application No. . 



3. □ Copies of the certified copies of the priority documents have been received in this national stage application from the 
International Bureau (PCT Rule 17.2(a)). 
* Certified copies not received: . 

Applicant has THREE MONTHS FROM THE "MAILING DATE" of this communication to file a reply complying with the requirements 
noted below. Failure to timely comply will result in ABANDONMENT of this application. 
THIS THREE-MONTH PERIOD IS NOT EXTENDABLE. 

5. □ A SUBSTITUTE OATH OR DECLARATION must be submitted. Note the attached EXAMINER'S AMENDMENT or NOTICE OF 

INFORMAL PATENT APPLICATION (PTO-152) which gives reason(s) why the oath or declaration is deficient. 

6. □ CORRECTED DRAWINGS ( as "replacement sheets") must be submitted. 

(a) □ including changes required by the Notice of Draftsperson's Patent Drawing Review ( PTO-948) attached 

1) □ hereto or 2) □ to Paper No./Mail Date . 

(b) □ including changes required by the attached Examiner's Amendment / Comment or in the Office action of 

Paper No./Mail Date . 

Identifying indicia such as the application number (see 37 CFR 1.84(c)) should be written on the drawings in the front (not the back) of 
each sheet. Replacement sheet(s) should be labeled as such in the header according to 37 CFR 1.121(d). 

7. □ DEPOSIT OF and/or INFORMATION about the deposit of BIOLOGICAL MATERIAL must be submitted. Note the 

attached Examiner's comment regarding REQUIREMENT FOR THE DEPOSIT OF BIOLOGICAL MATERIAL. 



Attachment(s) 

1. □ Notice of References Cited (PTO-892) 5. □ Notice of Informal Patent Application (PTO-152) 

2. □ Notice of Draftperson's Patent Drawing Review (PTO-948) 6. □ Interview Summary (PTO-413), 

Paper No./Mail Date . 

3. □ Information Disclosure Statements (PTO-1449 or PTO/SB/08), 7. ^ Examiner's Amendment/Comment 

Paper No./Mail Date 

4. □ Examiner's Comment Regarding Requirement for Deposit 8. Examiner's Statement of Reasons for Allowance 

of Biological Material 9. □ Other . 



U.S. Patent and Trademark Office 
PTOL-37 (Rev. 1-04) 



Notice of Allowability 



Part of Paper No./Mail Date 10-829X93 



Application/Control Number: 1 0/829, 1 93 Page 2 

Art Unit: 1621 

Examiners Amendment. 

An examiner's amendment to the record appears below. Should the changes and/or 
additions be unacceptable to applicant, an amendment may be filed as provided by 37 
CFR 1.312. To ensure consideration of such an amendment, it MUST be submitted no 
later than the payment of the issue fee. 

Authorization for this examiner's amendment was given in a telephone interview with 
Mr. Gerald Murphy on 04-05-05. 
-Claim 6 is cancelled. 

--In claim 7, line 3, before the word "and", delete the letter "a." 
Reasons For Allowance. 

The following is an Examiner's reason for allowance. 

Applicants' argument filed on 01-18-05 to over come the 35 USC 103 rejection made in 
the office action of 09-28-04 is found convincing. 

Additionally, Applicants' process for preparing a silyl ketene acetal according to claim 
one of the instant application is neither obvious nor suggested over the prior art of 
record. 

Dinh et. al teach a process of preparing a silyl ketene acetal by reacting an oc,p- 
unsaturated hydrosilane or hydrosiloxane in the presence of Rhcl(di-tert-butylsulfide)2 
catalyst. Dinh et. al do not teach the use of a tris(pentafluorophenyl)borane. 
The selection of a tris(pentafluorophenyl)borane catalyst in this reaction would not have 
been suggested to one of ordinary skill in the art at the time the invention was made. 
Thus, the Examiner finds claims 1-5, 7-15 allowable. 



Application/Control Number: 10/829,193 Page 3 

Art Unit: 1621 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Lansana Nyalley whose telephone number is 
571 ,272,0697 and the fax number is 703-746-3098. The examiner can normally be 
reached on 7:45 to 4:45. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Johann Richter can be reached on 571 272 0646. The fax phone number 
for the organization where this application or proceeding is assigned is 703 8 72 0 3 06 . 
Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status 
information for unpublished applications is available through Private PAIR only. For 
more information about the PAIR system, see http://pair-direct.uspto.gov. Should you 
have questions on access to the Private PAIR system, contact the Electronic Business 
Center (EBC) at 866-217-9197 (toll-free). 



Lansana Nyalley, Ph.D 





04/04/05 Shailendra Kumar. 

Technology Center 1600 
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Interview Summary 


Application No. 

10/829,193 


Applicant(s) 

KIYOMORI ETAL 


Examiner 

Lansana Nyalley 


Art Unit 

1621 





All participants (applicant, applicant's representative, PTO personnel): 



(1 ) Lansana Nyalley . (3) . 

(2) . (4) . 

Date of Interview: April -5-2005 . 

Type: a)[3 Telephonic b)D Video Conference 

c)D Personal [copy given to: 1)D applicant 2)D applicant's representative] 

Exhibit shown or demonstration conducted: d)D Yes e)S No. 
If Yes, brief description: . 

Claim(s) discussed: 6 and 7 . 

Identification of prior art discussed: NO. 

Agreement with respect to the claims f)S was reached. g)D was not reached. h)D N/A. 



Substance of Interview including description of the general nature of what was agreed to if an agreement was 
reached, or any other comments: Applicant sauthorized the Examiner to cancel claim 6 and to delete the letter"a" 
before the word "and" in claim 7. 



(A fuller description, if necessary, and a copy of the amendments which the examiner agreed would render the claims 
allowable, if available, must be attached. Also, where no copy of the amendments that would render the claims 
allowable is available, a summary thereof must be attached.) ' * 

THE FORMAL WRITTEN REPLY TO THE LAST OFFICE ACTION MUST INCLUDE THE SUBSTANCE OF THE * 
INTERVIEW. (See MPEP Section 713.04). If a reply to the last Office action has already been filed, APPLICANT IS 
GIVEN ONE MONTH FROM THIS INTERVIEW DATE, OR THE MAILING DATE OF THIS INTERVIEW SUMMARY 
FORM, WHICHEVER IS LATER, TO FILE A STATEMENT OF THE SUBSTANCE OF THE INTERVIEW. See 
Summary of Record of Interview requirements on reverse side or on attached sheet. 



Examiner Note: You must sign this form unless it is an 

Attachment to a signed Office action. Examiner's signature, if required 



U.S. Patent and Trademark Office 

PTOL-41 3 (Rev. 04-03) Interview Summary Paper No. 2004091 4 



Summary of Record of Interview Requirements 

Manual of Patent Examining Procedure (MPEP), Section 713.04, Substance of Interview Must be Made of Record 

A complete written statement as to the substance of any face-to-face, video conference, or telephone interview with regard to an application must be made of record in the 
application whether or not an agreement with the examiner was reached at the interview. 

Title 37 Code of Federal Regulations (CFR) § 1 .1 33 Interviews 
Paragraph (b) 

In every instance where reconsideration is requested in view of an interview with an examiner, a complete written statement of the reasons presented at the interview as 
warranting favorable action must be filed by the applicant. An interview does not remove the necessity for reply to Office action as specified in §§ 1 .1 1 1 , t .135. (35 U.S.C. 132) 

37 CFR §1.2 Business to be transacted in writing. 
All business with the Patent or Trademark Office should be transacted in writing. The personal attendance of applicants or their attorneys or agents at the Patent and 
Trademark Office is unnecessary. The action of the Patent and Trademark Office will be based exclusively on the written record in the Office. No attention wilt be paid to 
any alleged oral promise, stipulation, or understanding in relation to which there is disagreement or doubt. 



The action of the Patent and Trademark Office cannot be based exclusively on the written record in the Office if that record is itself 
incomplete through the failure to record the substance of interviews. 

It is the responsibility of the applicant or the attorney or agent to make the substance of an interview of record in the application file, unless 
the examiner indicates he or she will do so. It is the examiner's responsibility to see that such a record is made and to correct material inaccuracies 
which bear directly on the question of patentability. 

Examiners must complete an Interview Summary Form for each interview held where a matter of substance has been discussed during the 
interview by checking the appropriate boxes and filling in the blanks. Discussions regarding only procedural matters, directed solely to restriction 
requirements for which interview recordation is otherwise provided for in Section 812.01 of the Manual of Patent Examining Procedure, or pointing 
out typographical errors or unreadable script in Office actions or the like, are excluded from the interview recordation procedures below. Where the 
substance of an interview is completely recorded in an Examiners Amendment, no separate Interview Summary Record is required. 

The Interview Summary Form shall be given an appropriate Paper No., placed in the right hand portion of the file, and listed on the 
"Contents" section of the file wrapper. In a personal interview, a duplicate of the Form is given to the applicant (or attorney or agent) at the 
conclusion of the interview. In the case of a telephone or video-conference interview, the copy is mailed to the applicant's correspondence address 
either with or prior to the next official communication. If additional correspondence from the examiner is not likely before an allowance or if other 
circumstances dictate, the Form should be mailed promptly after the interview rather than with the next official communication. 

The Form provides for recordation of the following information: 

- Application Number (Series Code and Serial Number) 

- Name of applicant 

- Name of examiner 

- Date of interview 

- Type of interview (telephonic, video-conference, or personal) 

- Name of participant(s) (applicant, attorney or agent, examiner, other PTO personnel, etc.) 

- An indication whether or not an exhibit was shown or a demonstration conducted 

- An identification of the specific prior art discussed 

- An indication whether an agreement was reached and if so, a description of the general nature of the agreement (may be by 
attachment of a copy of amendments or claims agreed as being allowable). Note: Agreement as to allowability is tentative and does 
not restrict further action by the examiner to the contrary. 

- The signature of the examiner who conducted the interview (if Form is not an attachment to a signed Office action) 

It is desirable that the examiner orally remind the applicant of his or her obligation to record the substance of the interview of each case. It 
should be noted, however, that the Interview Summary Form will not normally be considered a complete and proper recordation of the interview 
unless it includes, or is supplemented by the applicant or the examiner to include, all of the applicable items required below concerning the 
substance of the interview. 

A complete and proper recordation of the substance of any interview should include at least the following applicable items: 

1) A brief description of the nature of any exhibit shown or any demonstration conducted, 

2) an identification of the claims discussed, 

3) an identification of the specific prior art discussed, 

4) an identification of the principal proposed amendments of a substantive nature discussed, unless these are already described on the 
Interview Summary Form completed by the Examiner, 

5) a brief identification of the general thrust of the principal arguments presented to the examiner, 

(The identification of arguments need not be lengthy or elaborate. A verbatim or highly detailed description of the arguments is not 
required. The identification of the arguments is sufficient if the general nature or thrust of the principal arguments made to the 
examiner can be understood in the context of the application file. Of course, the applicant may desire to emphasize and fully 
describe those arguments which he or she feels were or might be persuasive to the examiner.) 

6) a general indication of any other pertinent matters discussed, and 

7) if appropriate, the general results or outcome of the interview unless already described in the Interview Summary Form completed by 
the examiner. 

Examiners are expected to carefully review the applicant's record of the substance of an interview. If the record is not complete and 
accurate, the examiner will give the applicant an extendable one month time period to correct the record. 

Examiner to Check for Accuracy 

If the claims are allowable for other reasons of record, the examiner should send a letter setting forth the examiner's version of the 
statement attributed to him or her. If the record is complete and accurate, the examiner should place the indication, "Interview Record OK" on the 
paper recording the substance of the interview along with the date and the examiner's initials. 



2 



Issue Classification 


Application/Control No. 
10/829,193 


Applicant(s)/Patent under 
Reexamination 

KIYOMORI ET AL. 


Examiner 
Lansana Nyalley 


Art Unit 
1621 





ORIGINAL : 

.: CLASS : SUBCLASS 

,:. ..556, . : ' ; 446; "! 


mm is 
* \j 

iijieLASS;:;; 

;T5 : 56;:: ; : 


►SUE 

'WW ^B- - 

||;443j 


CI 


MASSIF 


ICATIC 

::: ;;;; :: ::::::CRO 

»UBCLASS(0 


»N 

SS REFE 
NESUBC 


RENC 

*A.s 


:E(S)::; : ;j:;: : 

SPERjBLOCK 






j : i : INTERNATIONAL: CLASSIFICATION ; ; ; ; ; 






















c: 


:0 ; 


7- 




7/18 






































































































































































V LANSANA 

: (Assistai 


NYALLEY,; 04-04-05 

it Examiner) : (Date) 


SHAILENDRA KUMAR, 04-04-05 : 

(Primary Examiner) (Date) 


Total Claims/ 


J lowed: 14 


(Legal Instruments Examiner; (Date) : 


. o.g. : ; 

Print Claim(s) 
1 


O.G; 
Print Fig. 



I | Claims renumbered in the same order as presented by applicant 


□ CPA 


□ T.D. 


□ R.1.47 


Final 


Original 




Final 


Original 




Final 


Original 




Final 


Original 




Final 


Original 




Final 


Original 




Final 


Original 


1 


1 






31 






61 






91 






121 






151 






181 


2 


2 






32 






62 






92 






122 






152 






182 


3 


3 






33 






63 






93 






123 






153 






183 


4 


4 






34 






64 






94 






124 






154 






184 


5 


5 






35 






65 






95 






125 






155 






185 




6 






36 






66 






96 






126 






156 






186 


6 


7 






37 






67 






97 






127 






157 






187 


7 


8 






38 






68 






98 






128 






158 






188 


8 


9 






39 






69 






99 






129 






159 






189 


9 


10 






40 






70 






100 






130 






160 






190 


10 


11 






41 






71 






101 






131 






161 






191 


11 


12 






42 






72 






102 






132 






162 






192 


12 


13 






43 






73 






103 






133 






163 






193 


13 


14 






44 






74 






104 






134 






164 






194 


14 


15 






45 






75 






105 






135 






165 






195 




16 






46 






76 






106 






136 






166 






196 




17 






47 






77 






107 






137 






167 






197 




18 






48 






78 






108 






138 






168 






198 




19 






49 






79 






109 






139 






169 






199 




20 






50 






80 






110 






140 






170 






200 




21 






51 






81 






111 






141 






171 






201 




22 






52 






82 






112 






142 






172 






202 




23 






53 






83 






113 






143 






173 






203 




24 






54 






84 






114 






144 






174 






204 




25 






55 






85 






115 






145 






175 






205 




26 






56 






86 






116 






146 






176 






206 




27 






57 






87 






117 






147 






177 






207 




28 






58 






88 






118 






148 






178 






208 




29 






59 






89 






119 






149 






179 






209 




30 






60 






90 






120 






150 






180 






210 



U.S. Patent and Trademark Office Part of Paper No. 10-82929 



Index of Claims 




Application/Control No. 
10/829,193 


Applicant(s)/Patent under 
Reexamination 

KIYOMORI ET AL. 


Examiner 
Lansana Nyalley 


Art Unit 
1621 







Rejected 




Allowed 



(Through numeral) 
Cancelled 



Restricted 



Non-Elected 



Interference 



Claim 


Date 


Final 


Original 


4/4/05 | 




















1 


= 




















2 


= 




















3 


= 




















4 


= 




















5 


= 






















- 




















7 


= 




















8 


= 




















9 


= 




















10 


= 




















11 


= 




















12 






















13 






















14 


s 




















15 


= 




















16 






















17 






















18 






















19 






















20 






















21 






















22 






















23 






















24 






















25 






















26 






















27 






















28 






















29 






















30 






















31 






















32 






















33 






















34 






















35 






















36 






















37 






















38 






















39 






















40 






















41 






















42 






















43 






















44 






















45 






















46 






















47 






















48 






















49 






















50 





















Claim 


Date 


Final 


Original 






















51 






















52 






















53 






















54 






















55 






















56 






















57 






















58 






















59 






















60 






















61 






















62 






















63 






















64 






















65 






















66 






















67 






















68 






















69 






















70 






















71 






















72 






















73 






















74 






















75 






















76 






















77 






















78 






















79 






















80 






















81 






















82 






















83 






















84- 






















85 






















86 






















87 






















88 






















89 






















90 






















91 






















92 






















93 






















94 






















95 






















96 






















97 






















98 






















99 






















100 





















Appeal 



Objected 



Claim 


Date 


Final 


Original 






















101 






















102 






















103 






















104 






















105 






















106 






















107 






















108 






















109 






















110 






















111 






















112 






















113 






















114 






















115 






















116 






















117 






















118 






















119 






















120 






















121 






















122 






















123 






















124 






















125 






















126 






















127 






















128 






















129 






















130 






















131 






















132 






















133 






















134 






















135 






















136 






















137 






















138 






















139 






















140 






















141 






















142 






















143 






















144 






















145 






















146 






















147 






















148 






















149 






















150 





















U.S. Patent and Trademark Office 



Part of Paper No. 10-82929 



Search Notes 


Application/Control No. 
10/829,193 


Applicant(s)/Patent under 
Reexamination 

KIYOMORI ET AL 


Examiner 
Lansana Nyalley 


Art Unit 
1621 





SEARCHED 


Class 


Subclass 


Date 


Examiner 


556 


443, 446 


4/4/2005 


LN 











































































































INTERFERENCE SEARCHED 


Class 


Subclass 


Date 


Examiner 


556 


443,446 


4/4/2005 


LN 

























U.S. Patent and Trademark Office 



SEARCH NOTES 
(INCLUDING SEARCH STRATEGY 






DATE 


EXMR 


LN WEST, EAST, NPL, STN(FILE 
REGISTRY, CAPLUS, HCAPLUS, 
UAPSTFUL, CAOLD, EUROPATFUL, 
CAS REACT) ' 


4/4/2005 


LN 


INVENTOR NAME SEARCH 


4/4/2005 


LN 







































Part of Paper No. 10-82929 



Page 1 of 2 



United States Rvtent and Trademark Office 




UNITED STATES DEPARTMENT OF COMMERCE 
Uuited States Patent and Trademark Office 

Addre»: COMMISSIONER FOR PATENTS 
P.O. Box 1450 

Altocandri^ViisaiM 22313-1450 
www.iuploguv 



CONFIRMATION NO. 5551 



Bib Data Sheet 



SERIAL NUMBER 
10/829,193 



FILING DATE 
04/22/2004 

RULE 



CLASS 
556 



GROUP ART UNIT 
1621 



ATTORNEY 
DOCKET NO. 

0171-1086PUS1 



APPLICANTS 

Ayumu Kiyomori, Niigata-ken, JAPAN; 
Tohru Kubota, Niigata-ken, JAPAN; 



CONTINUING DATA 



★it*********************** 



■** FOREIGN APPLICATIONS ******************** 
JAPAN 2003-121366 04/25/2003 



fio, U 



IF REQUIRED, FOREIGN FILING LICENSE GRANTED 
06/27/2004 



Q Met after 
I Initials 



Foreign Priority claimed 

35 USC 1 19 (a-d) conditions 
met 



Verified and 
Acknowledged 




STATE OR 

COUNTRY 
JAPAN 



SHEETS 

DRAWING 
0 



TOTAL 

CLAIMS 
6 



INDEPENDENT! 

CLAIMS 
3 



ADDRESS 
02292 

BIRCH STEWART KOLASCH & BIRCH 

PO BOX 747 

FALLS CHURCH , VA 

I22040-0747 



TITLE 

PREPARATION OF SILYL KETENE ACETAL AND DISILYL KETENE ACETAL 



FILING FEE 

RECEIVED 
770 



FEES: Authority has been given in Paper 

No. to charge/credit DEPOSIT ACCOUNT 

No. for following: 



□ All Fees 



□ 1.16 Fees (Filing) 



Q 1.17 Fees ( Processing Ext. of 
time ) 



D 1.18 Fees ( Issue ) 



http://neo:8000/PrexServlet/PrexAction?serviceName=BibDataSheet«&Action=display&brows... 4/7/05 



Page 2 of 2 

□ Other | 

□ Credit 



http://neo:8000/PrexServlet/PrexAction?serviceName=BibDataSheet&Action=display&brows... 4/7/05 



WO 91/18361 



PCT/US91/03504 



13 

encoding, the decoding relationships will be as follows: 
For y odd 

y x = h 1 sy 1 + h 3 sy 0 + g 1 dy 1 + g 3 dy 0 
y 3 - Vy 2 + h 3 s yi + g x dy 2 + g 3 d yi 

. (10) 

For v even 

y 2 ■ hjsy x + h 4 sy 0 + g 2 dy 1 + g 4 dy 0 
y 4 = h 2 sy 2 + h 4 sy 1 + g 2 dy 2 + g 4 dy x 

(11) 

• 

The values mapped into the parent mode are accumulated and, as In 
the encoder, extra values at the end positions (e.g. at y 0 above) 
c a be handled by "wrap-around", truncation, or other known means 
of handling end conditions. 

Referring to Fig. 16, there is shown a flow diagram which, 
when taken together with the further flow diagrams referred to 
therein, is suitable for controlling the processor to implement 
an embodiment of the encoding apparatus and method in accordance 
with the invention. The block 1610 represents the generating of 
processed values by correlating wavelet-packets with the input 
signal samples. There are various ways in which this can be 
achieved, the routine of Fig. 17 describing an implementation of 
the present embodiment. The block 1620 represents the routine, 
described further in conjunction with Fig. 18, for computing the 
"information costs of the processed values. As described' further 
hereinbelow, there are various ways of computing the measure or 
cost of information contained in the processed values. In an 
illustrated embodiment, a thresholding procedure is utilized, and 
information cost is determined by the number of values which 
exceed a particular threshold. The block 1630 represents the 
routine of Fig. 19 for selection of an advantageous orthogonal 
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basis from among the processed values, the selection of the basis 
being dependent on the computed information costs. The block 
1640 represents compiling encoded frames from the selected 
processed values which constitute the basis, such as for 
subsequent recovery after processing, storage, and/or 
transmission. This routine is described in conjunction with 
Fig. 20. 

Referring to Fig. 17,* there is shown a flow diagram of a 
routine for generating the processed values from the sampled 
signal, or signal portion/ using a wavelet-packet basis. The 
block 1710 represents the reading in of the selected coefficients 
\,q t . The block 1720 is then entered, this block representing 
the initializing of a level index at 0, the initializing of a 
node index at 1, and the initializing of a position index at 1. 
The sample data, considered as level 0 is then read in, as 
represented by the block 1725. The sample data may consist, for 
example, of 256 sequential samples of an acoustical signal to be 
compressed and transmitted. The level index is then 
incremented, as represented by block 1730, and the first level 
processed values are computed and stored in accordance with the 
relationships (4) and (5) set forth above (block 1735 and loops 
1748 and 1760). For example, for the first position of the first 
node of level 1, s x will be computed. If the wavelet employed is 
representable by a filter having four coefficients, as in the 
example above, s x will be computed as the sum of h^, h 2 x 2 , h 3 x 3 , 
h 4 x 4 . If a wavelet of more vanishing moments is used, more 
coefficients will be employed. In general, it will be preferable 
to utilize a wavelet having several coefficients, greater than 
four, the above examples being set forth for ease of 
illustration. 

In loop 1748, inquiry is made (diamond 1740) as to whether 
the last position of the current node has been reached. If not, 
the position index is incremented (block 1745), and the block 
1735 is re-entered for computation of the next processed value 
of the current node and level. The loop 1748 is then continued 
until all processed values have been computed for the current 
node, whereupon inquiry is made (diamond 1750) as to whether the 
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last node of the current level has been reached. If not, the 
node index is incremented (block 1755} and the loop 1760 is 
continued until the processed values have been computed for all 
nodes of the current level. For the first level, there will be 
only two nodes / with the values thereof being computed in 
accordance with the relationships (4) and (5) set forth above. 

When the inquiry of diamond 1750 is answered in the 
affirmative, diamond 1770 is entered, and inquiry is made as to 
whether the last level has been processed. If not, the block 
1730 is re-entered, to increment the level index, and the loop 
1780 is continued until processed values have been obtained for 
the nodes at all levels of the tree. 

Referring to Fig. 18, there is shown a flow diagram of the 
routine for computing the information cost of the nodes of the 
tree, so that an advantageous orthogonal basis can be selected. 
The block 1810 represents initializing the level index to the 
highest level (e.g., the last level in the illustration of Fig. 
3). The node index and the position index are initialized at 1 
(blocks 1815 and 1820). A node content count, which is used in 
the present embodiment to keep track of the number of processed 
values in a node that exceed a predetermined threshold, is 
initialized at zero, as represented by the block 1825. Inquiry 
is then made (diamond 1830) as to whether the value at the 
current position is less than a predetermined threshold value. 
If not, the node content count is incremented (block 1835), and 
the diamond 1840 is entered. If, however, the processed value at 
the current position is less than the threshold value, the 
diamond 1840 is entered directly. [At this point, the processed 
value could be set to zero prior to entry of diamond 1840 from 
the "yes" output branch of diamond 1830, but it is more efficient 
to handle this later.] Inquiry is then made (diamond 1840) as to 
whether the last position of the node has been reached. If not, 
the position index is incremented (block 1850), diamond 1830 is 
re-entered, and the loop 1855 is continued until all processed 
values of the current node have been considered. When this 
occurs, the node content count is stored for the current node (of 
the current level), as represented by the block 1860. Inquiry 
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is then made (diamond 1865) as to whether the last node of the 
level has been processed. If not, the block 1870 is entered, 
the node index is incremented, the block 1820 is re-entered, and 
the loop 1875 is continued until all nodes of the current level 
have been considered. Inquiry is then made (diamond 1880) as to 
whether the current level is the highest level. If so, there is 
no higher level against which comparison of parent-to-children 
node comparisons can be made. In such case, the level index is 
incremented (block 1885), block 1815 is re-entered, and the 
procedure just described is repeated to obtain and store node 
content counts for each node of the next-to-highest level. When 
this has been done, the inquiry of diamond 1880 will be answered 
in the negative, and the next routine (Fig. 19) will be operative 
to compare the level (which has just been processed to compute 
information cost of each node) with the children nodes of the 
previously processed higher level. 

In particular, the level index is initialized (block 1905) 
to the highest level less one, and all nodes on the highest level 
are marked "kept". The node index is initialized (block 1910) 
and the node content count of the current node of the current 
level is compared (block 1920) to the sum of the node content 
counts of the two nodes which are children of the current node. 
[For example, if the current node is ti ± and the current level is 
Lj, then the count for the current node is compared to the sum of 
the counts for nodes N 2i-1 and of level L jn .] If the 
comparison shows that the parent has an equal or lower count, the 
parent is marked "kept", and the two children nodes are marked 
"not kept" (as represented by the block 1930). Conversely, if 
the comparison shows that the sum of two children nodes has a 
lower count than the parent node, each of the children nodes 
keeps its current mark, and the current parent node is marked 
"not kept" (as represented by the block 1940). In the case where 
the children nodes are preferred, the sum of the counts of the 
children nodes are attributed to the parent node (block 1945). 
By so doing, the lowest count will be used for subsequent 
comparisons as ancestors are examined. The attribution of the 
count to the parent node will not be problematic, since only 
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"kept" nodes will be considered in the next stage of processing. 
Inquiry is then made (diamond 1950) as to whether the last node 
of the current level has been reached. If not, the node index is 
incremented (block 1955) , block 1920 is re-entered, and the loop 
1958 is continued until all nodes at the current level have been 
considered. Inquiry is then made (diamond 1960) as to whether 
the current level is level 1. If not, the level index is 
decremented (block 1965), block 1815 (Fig. 18) is re-entered, and 
the loop 1970 continues until all levels have been considered. 
At this point, the nodes which define the basis to be used have 
been marked "kept" [possibly together with some of their 
descendent nodes], and correspond, for example, to the shaded 
nodes of the Fig. 4 illustrations. 

Referring to Fig. 20, there is shown a flow diagram of a 
routine for generating output encoded words which, in the 
present embodiment, are collected in a frame which represents the 
encoded form of the data x x , x 2 , x 3 ... x n . For example, for an 
acoustical signal, the frame may represent a particular number of 
acoustical samples, for example 256 samples. As a further 
example, for a video signal, the frame may represent a frame of 
video, portion thereof, or transformed frequency components 
thereof. The number of encoded words in a frame will generally 
vary as the information being encoded varies, and will also 
generally depend upon the level of the threshold employed, if a 
threshold is employed as in the present embodiment. Fig. 20 
illustrates an embodiment of a routine for generating a frame of 
words for the basis that was selected using the routines of Fig.s 
18 and 19. A tree location index will be calculated which points 
to nodes in the tree in depth-first order (or so-called 
"pre-order") , as is well known in the art. The tree location 
'index is initialized to 1 at level 0, node 1 (block 2010) . 
Inquiry is made (diamond 2015) as to whether the node at that 
tree location is market "kept", and, if not, diamond 2020 is 
entered directly, and inquiry is made as to whether the entire 
tree has been examined, as indicated by the tree location index. 
If the entire tree has been searched, block 2080 is entered and a 
"frame complete" indication can be generated. If not, then loop 
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2011 is continued until a node marked "kept" is encountered, or 
until the entire tree has been searched. If a node marked "kept" 
is encountered, block 2030 is entered, and the tree location 
index of this "kept" node is recorded in memory; suppose for 
example that it is called "X", The position index in the node is 
initialized (block 2035). Inquiry is then made (diamond 2040) as 
to whether the value at the current position is above the 
predetermined threshold. If not, diamond 2055 is entered 
directly, and no word is generated for the value at the current 
position. If the value is above the threshold, block 2045 is 
entered, this block representing the generation of a word which 
includes the current level, node, and position, and the value at 
the position. The block 2050 is then entered, this block 
representing the loading of the just generated word into an 
output register. Inquiry is then made (diamond 2055) as to 
whether the last position in the current node has been reached. 
If not, the position is incremented (block 2060), diamond 2040 is 
re-entered, and the loop 2061 is continued until all positions in 
the node "X" have been considered. It will be understood that 
various formats can be used to represent the words. For 
example, a specific number of bits can be used for each of the 
level, node, position, and value. Alternatively, words could be 
of different length, e.g. depending on information content or 
entropy, with suitable delineation between words, as is known in 
the art. Also, if desired, all words in a particular node could 
be encoded with a single indication of level and node, with 
individual indications of posit ion- value pairs. Inquiry is next 
made (diamond 2070), as to whether the last node location in the 
tree in depth- first order has been reached. If not, the tree 
location index is incremented (block 2070), and inquiry is made 
as to whether the new node is a descendant of "X" , by a - 
comparison of depth-first indices well known in the art. When 
this is the case, diamond 2065 is re-entered, and the loop 2071 
is continued until the first node which is not a descendant of 
"X" is encountered, or until there are no more nodes. When a 
first non-descendant of "X" is encountered, diamond 2015 is 
re-entered and the loop 2081 is continued until all nodes which 
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are both marked "kept" and have no ancestors marked "kept" have 
contributed to the frame. Such nodes contain a complete 
orthogonal group of wavelet-packet correlations (see also 
Appendix I, II, and V). When either loop 2011 or the loop 2071 
terminates by exhaustion of the nodes, block 2080 is entered and 
a "frame complete" indication can be generated. If desired, the 
frame can then be read out of the encoder register. However, it 
will be understood that the encoder register can serve as a 
buffer from which words can be read-out synchronously or 
asynchronously, depending on the application. 

Referring to Fig. 21, there is shown a flow diagram of the 
decoder routine for processing frames of words and 
reconstructing the orthogonal basis indicated by the words of a 
frame. The block 2110 represents the reading in of the next 
frame. In the described embodiment, it is assumed that the 
frames of words are read into a buffer (e.g. associated with 
decoder processor subsystem 170 of Fig. 1), and the individual 
words processed sequentially by placement into appropriate 
addresses (which can be visualized as the selected basis nodes 
of a tree - as in Fig. 4), from which reconstruction is 
implemented in the manner to be described. However, it will be 
understood that individual words can be received synchronously or 
asynchronously, or could be output in parallel into respective 
tree nodes, if desired. Also, as was the case with the encoder, 
parallel processing or network processing could be employed to 
implement reconstruction, consistent with the principles hereof. 
In the routine of Fig. 21, the next word of the frame is read 
(block 2115) , and a determination is made as to whether the node 
and level of the word is occurring for the first time (diamond 
2117). If so the node (and its level) is added to the list of 
nodes (block 2118). The value indicated in the word is stored 
(block 2120) at a memory location indicated by the level, node, 
and position specified in the word. It will be understood that 
memory need be allocated only for positions within the nodes 
designated by the read-in words. Inquiry is then made (diamond 
2130) as to whether the last word of the frame has been reached. 
If not, the block 2115 is re-entered, and the loop 2135 is 
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continued until all words of the frame have been stored at 
appropriate locations. It will be understood that, if desired, 
the word locations (level, node, and position) could 
alternatively be stored, and the values subsequently recovered by 
pointing back to their original storage locations. 

During the next portion of the decoder routine, as shown in 
Fig. 22, the values in the nodes on the list are utilized to 
implement reconstruction as in the diagram of Fig.s 15A and 15B, 
with parent nodes being reconstructed from children nodes until 
the level zero information has been reconstructed. During this 
procedure, when a parent node is reconstructed from its children 
nodes, the parent node is added to the list of nodes, so that it 
will be used for subsequent reconstruction. This part of the 
procedure begins by initializing to the first node on the list 
(block 2210). Next, the block 2215 represents going to the 
memory location of the node and initializing to the first 
position in the node. Inquiry is then made (diamond 2220) as to 
whether there is a non-zero value at the position. If not, 
diamond 2240 is entered directly. If so, the value at the 
position is mapped into the positions of the parent node, with 
accumulation, as described above in conjunction with 
relationships (10) and (11). Inquiry is then made (diamond 2240) 
as to whether the last position of the node has been reached. If 
not, the next position in the node is considered (block 2245), 
diamond 2220 is re-entered, and the loop 2250 continues until all 
positions in the node have been considered. It will be 
understood that, if desired, a marker or vector can be used to 
indicate strings of blank positions in a node, or to point only 
to occupied positions, so that a relatively sparse node will be 
efficiently processed. In this regard, reference can be made to 
the abovereferenced U.S. Patent Application Serial No. 525>,974. 
When the last position of the node has been considered, the node 
is removed from the list of nodes, as represented by block 2255, 
and inquiry is made (diamond 2260) as to whether the parent node 
is at level 0. If so, diamond 2270 is entered directly. If, 
however , the parent node is not at level 0, the parent node is 
added to the list of nodes (block 2265). Inquiry is then made 
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(diamond 2270) as to whether the last node on the list has been 
reached. If not, the next node on the list is considered (block 
2275), block 2215 is re-entered, and the loop 2280 is continued 
until processing is complete and the reconstructed values have 
been obtained. The decoder output values can then be read out 
(block 2290). 

It will be understood that similar techniques can be 
employed at higher dimensions and in other forms (see e.g. 
Appendix V). More complicated tree structures, such as where a 
node has more than two children (e.g. Appendices II and V) can 
also be utilized. 

The invention has been described with reference to 
particular preferred embodiments, but variations within the 
spirit and scope of the invention will occur to those skilled in 
the art. For example, it will be recognized that the wavelet 
upon which the wavelet-packets are based can be changed as 
different parts of a signal are processed. Also, the samples can 
be processed as sliding windows instead of segments. 
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Appendix I 
Construction of Wavelet-Packets 

We introduce a new class of ortlionormal bases of L 2 (R n ) by constructing a "library" 
of modulated wave forms out of which various bases can be extracted. In particular, 
the wavelet basis, the walsh functions, and rapidly oscillating wave packet bases are 
obtained. 

We'll use the notation and terminology of [D], whose results we shall assume. 

§1. We are given an exact quadrature mirror filter h{n) satisfying the conditions of 
Theorem (3.6) in [D], p. 964, i.e. 

J2 h ( n - ^)h(n - 2£) = S ije , J2 Mn) = V2. 
We let g k = /i fc+ i(-l) fc and define the operations f f on ^(Z) into "£ 2 (2Z) r 

Fi{sk}(i) = 2j2s k g k _ 2i . 
The map F(s k ) = F 0 (s k ) e F z (s k ) € fi(2Z) 8 ^(2Z) is orthogonal and 
(1-1) FgF 0 +FiFi=I 
We now define the following sequence of functions. 

(L2) (W in (x) = y/2j:h k W n (2x-k) 

X 'HWi(i) = V2 E 9kW n (2x -k)' 

Clearly the function W 0 {x) can be identified with the function <p in [D] aud W x with 
the function tp. 

Let us define mo(f ) = -fe £ ^e - ^ and 
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Remark: The quadrature mirror condition on the operation F = (F 0 , Fi ) is equiv- 
alent to the unitarity of the matrix 



L»no(f + ir) f mi(e + ir)J 
Taking Fourier transform of (1.2). when n = 0 we get 

Wb(O = mo(e/2)W 0 (f/2) 



i.e., 



W 0 (0 = ]Jmo(t/2>) 

3=1 



and 



WM) = mi(£/2)W'b(£/2) = m 1 (^/2)7n 0 (f/4)7n 0 (f/2 3 ) • • • 
More generally, the relations (1.2) are equivalent to 

(1-3) W n (0 = f[m ej (t/V) 

3=1 

and n = § e,-2»- 1 (e, = 0 or 1). 

3=1 

We can rewrite (1.1) as follows. 

(1.4) W 2n (x -£) = y/2j^ h 3 - 2 eW n (2x - j) = F 0 {W n (2x - 

W 2n+l (x -£) = y/2 Y,93-uWn{2x -j) = F x {W n {2x - j)}(£) 

< where W n (2x -j) is viewed as a sequence in j for (jr,n) fixed. Using (1.1) we find: 
(1.5) 



W n (x - j) = h,- 2i W 2n (| - i) + 9,-2i W 2n+1 (| - 1) 



In the case n = 0 we obtain: 
(1.6) W 0 (x -k) = V2j2 h k - 2i W 0 (| - i) + g k - 2i Wi (| - z) 
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from which we deduce the usual decomposition of a function / in the space J2 0 {V 0 h 
[D]) i.e., a function / of the form 

= E ^b(-g)WWb (f-O+E ^i(«2)(0Wi (f - i) 

More generally, if we define 

( L7 ) = {/ : / = $> t W„(z - ifc)}. 

We find 

(1-8) /(x) = J) -±*FoMW in (f - <) + £ ^W)^ (| - i) 
or 

y/2f{2x) = h + g h e £l 2n g e fi 2 „+i 

We now prove 

Theorem (1.1). The functions W n {x - k) form an orthonormal basis of Z 2 (R). 

Proof. We proceed by induction on n, assuming that W n (x - k) form an orthonormal 
set of functions and, proving that, W 2n (x - k), W 2n+ i(x - k) form an o.n set. 

By assumption || y/2f(2x)g = £ u 2 k if / € Sl n from the quadrature mirror condition 
on (F Q ,Fi ) we get 

E w fc = E^^n*) 2 + KMW 2 - 

Since Jb(^fc)(*') = A*i, -Fb(wfc)(i) = can be chosen as two arbitrary sequences of I 2 
(arising from u = F^m + F{vi) it follows that 

/ I E ft^W* (* - i)\ 2 = £ /*? + £ ,/? 

which is equivalent to T7 2 „(x - i), W 2n +i(x - j) being an o.n set of functions. 

Let us now define Sf = y/2f(2x). Formula (1.8) shows that 6Sl n = fi 2n © fi 2rH -i as 
• an orthogonal sum or, 

(1.9) sa 0 - fi 0 = Hi 

5 2 fi 0 - tfflo = ssii =fi 2 efi 3 
ff 3 flo - s 2 a 0 = sn 2 © sn 3 = su © n 5 e n 6 © n 7 or 

and 
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5 fc f2o = fto © ^i © * * - © ^2*-i 
More generally, we let W k = £ fc+1 no - S k Sl 0 = = <J*Wi. Therefore we have 
Proposition (1.1). 

AJternativeiy, the functions 

W n (x-j) jeZ2 k <n< 2* +1 
form an orthonormal basis ofWk* 

Since the spaces are mutually orthogonal and span £ 2 (R) see [D], it follows that 
W n (x — j) are complete. 

§2. Orthonormal bases extracted out of the "library" 2 i / 2 W n {2 i x - k). 

We start by observing that 2 J / 2 Wi (TPx — k) form a basis of Wj as we vary k and a 
basis of £ 2 (R) as jf, k vary. This is the wavelet basis constructed in [D]. The following 
simple generalization is useful to obtain a better localization in frequency. space. 

Theorem (2.1). The functions 

2^ 2 W n (2 j x — k) j = 0, ±1, . . . , k = 0, ±1, ±2 

2* < n< 2* +1 for fixed £ form an orthonormal basis of £ 2 (R) £ = 0, 1, 2, . . . . 

Remark: This is a wavelet basis with dyadic dilations and 2* fundamental wavelets. 

Proof. We have seen, in Proposition (1.1), that W n (x - k) 2* < n < 2 £+1 fc € Z form 
an o.n basis of >Ve, from which we deduce that 2 3 / 2 W n (2*x — k) form an o.n. basis of 
We +i spanning L 2 (K) forjeZke Z. 

In the next example we vary j and n simultaneously to obtain a basis whose number 
of oscillation is inversely proportional to the length of its support. 

• Theorem (2.2). Let £{n) = [log 2 n] i.e., 2'< n > < n < 2* +1 then * . 

W n (2«">s - A)2 £ <">/ 2 , W n (2«"> +1 z - 
form an o.n basis of L 2 (R). 

Proof. Fix £(n) = and consider n with 2* < n < 2* +1 . as seen in the proof of 
Theorem (1.2) 

W n {2 £ x - &)2' /2 form an o.n basis of W 2 £ 
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and 



W n (2 l+1 x - k)2W 2 form an o.n basis of W 2t+1 
since L 2 = £ @W M e £ ©W 2 £+i, we have a complete basis. 



These can be generalized as follows. 



Theorem (2.3). Let a collection {I, n] be given such that the dyadic intervals J/, n = 
[2 e n, 2*(n+l)) form a disjoint covering of (0, oo), then TfiPWJpx-k) form a complete 
orthonormal basis of L 2 (R). 



which is the simplest variation on a "windowed" (2 windows) Fourier transform. The- 
orem (1.4) is obvious in this case. This theorem is also easy to understand from the 
point of view of subband coding as we shall see. 

§3. Subband coding and expansions in terms of W n 

We assume, given a function which, on the scale 2~ N , is well approximated as 



This theorem becomes obvious in the following case. Let 




a periodic function of period 2ir, and mi(£) = 1 - mo(f). Let 




• (3-1) 



f(x) = , £ i slWo(2 N x-k)2 N ' 2 



as seen in (1.8) 
(3.2) 



* 



/<*> 
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The coefficients of /o axe given by Fo(s°). 
The coefficients of f\ axe given by .Fi(s 0 ). 
Continuing an application of (1.8) gives 

= {>•» (!**)+* (f 2 ") + (f 0 + >» (««")} 

where /oo, /io are obtained by decomposing / 0 
and /oij/11 are obtained by decomposing /i 

/oo € fioj/io € fii,/oi € ^2^/11 € ^3- If we continue this decomposition and observe 

that the binary tree corresponds to the realization of n as n = J^j^" 1 and that after 

1 

I iterations we get 

(3.3) /(*) = 2<"-<>/ 2 2 / n («2 M ) with f n G Q n . 

fc=0 

and / n (x) = S(/,W P „(2^ - fc))W a (2^x - fc)2*- £ with 

(3.4) 2^</, W„(2^ - *)) = . . . F e , 

We therefore obtain a fast 2 N N algorithm to calculate all coefficients for "all functions 
in our library" for scales — N < j < 0. The procedure is analogous to subband coding. 

§4. Higher dimensional libraries and bases 

We define the higher dimensional wavelet basis as follows: Let 

Wit = S k Wi where Sf(xix 2 ) = 2/(2x!,2x 2 ). Clearly 

i 2 (R 2 )==J> fc . 

The basic 2-dimensional "library" consists of all functions obtained as tensor prod- 
ucts of the one dimensional library i.e., 

2tti*+Mw ni (2>*zi - h)W n2 {2 j *x 2 - hz). 

We will restrict our attention to the sublibraries obtained by dilating both variables 
by the same dilations although the case j 2 = rji r fixed is of independent interest. 
The two dimensional basis corresponding to Theorem (2.1) is given in 
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Theorem (4.1). Fixt, then for (k u k 2 ) e Z 2 j e Z 2 l < n < 2 e+1 , 

2>' 2 W n (2 j x 1 - k l )2^ i W 0 (2 e+ 'x 2 - 

2 i ^W 0 (2 t + i x l -k l )2 i t 2 W n (2>x 2 -k 2 ) 

2*W ni (2'x! - fc x ) Wn, (2'x 2 - h) 2 t <n i <2 e+1 

form an orthonozmal basis of I?. 

Theorem (4.2). Let <n) = (m,n 2 ) = 2 max W ni W n a» where 
£(ni) — [log 2 ni] n x > 0 n 2 > 0 then for (fc lf fcjj) 6 Z 2 , 

(n> • W ni ((n)xi - h)W^{{n)x 2 - h) 
<2n>W ni (2(n)x 1 - & 1 )Pr n2 (2(n)x 2 - fc 2 ) 

form an orthononnal basis (wavelet packet basis of L 2 {K 2 )). 
Proof. Assume £ = max (t{ni)l{n 2 )) = £(n 2 ) t i.e. ni < n 2 . Then 

2 £ W ni (2 £ Xi - k 1 )W n ,(2 t x 2 - k 2 ) 

for 

0 < m < 2* 2 i <n 2 <2 t+1 

span (using 1.9) Proposition (1.1) tf^fio^, ® tf^fti.!., i.e.. the subspace spanned by 
W 0 (2 2£ xi - fci)W!(2 M x 2 - fc 2 ). Consideration of the other 2 cases yields a total span 
of >V2£, similarly we obtain and the theorem is proved. 

Reference 

[D] Ingiid Daubechies, Orihonormal bases of compactly supported wavelets* Communications on 
Pure and Applied Mathematics XLI (1988), 909-966. 



SUBSTITUTE SHEET 



WO 91/18361 



PCT/US91/03504 



- 29 - 



n-i 

Appendix II 
Best-Adapted Wavelet-Packet Bases 

Introduction. By using extra filters, it is possible to introduce fast wave packet 
transformations which decimate by arbitrary numbers. Such transformations generalize 
algorithms which decimate by 2. The method produces new libraries of orthonormal 
basis vectors. We introduce an algorithm for selecting a most efficient representation 
from the library, and prove that its complexity is O(N) for a sequence of length N. 
We discuss some of the analytic properties and applications of such representations. 

Aperiodic filters and bases in I 7 . Consider first the construction of bases on I 2 . 
Let p be a positive integer and introduce p absolutely summable sequences /o, . . . , f p -i 
satisfying the properties: 

(1) For some e > 0, £ m LfcfaOlM* < *>i 

(2) £ m /o(m) = l, fori = 0,l,...,p-l, and 

(3) 52m fii m )fj( m + fcp) == £*-jftfei where 6 is the Kronecker symbol. 

To these sequences are associated p convolution operators Fo, . ~ -.-F^-i and their ad- 
joints 2*0 , . . . , F^Lj defined by 

F 4 : 1 2 - l\ F iV {k) = Y, fi(m + pk)v(m), 

m 

k 

These convolution operators will be called filters by analogy with quadrature mirror 
filters in the case p = 2. They have the following properties: 

• Lemma. For ij = 0,1, ... ,p - 1, 

(1) 2*17 = 0, if*Vi< 

(2) Fif? = I* 

(3) F*Fi is an orthogonal projection of I 2 , and for i ^ j the ranges of F*Fi and 
FfFj are orthogonal, and 

(4) FfFo + '-' + F^Fr-^L 

Research supported in part by ONR Grant N00014-88-K0020 
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Proof. Properties (1) and (2) follow by interchanging the order of integration: 
FiFjv(V) = Y,H Mm + pkVjim + pk)v(k) 

= E [ £/f<™UV + - fc']) J v(k) 

k \ m' / 
k 

^(V(k% if i=j\ 
10, if 

by the orthogonality properties of 

Property (3) follows from (1) and (2): F*F{F*Fi = F?Fi, aud FfFiFfFj = 0. 
Orthogonality is easily shown by transposition. 

To prove (4), let TOj*(0 = £ fc /i( fc ) e ^ be the (bounded, Holder continuous, peri- 
odic) function determined by the filter fa for j = 0, . . . ,p - 1. Then = rhj(k) 
is a real number, and each F*Fi is unitarily equivalent to multiplication by |mi| 2 on 
X 2 (-7r j7 r). 

Now Plancherel's theorem gives 

e^m^m^Od^^ + lp) = S^ r 6i. 

Jo t 

In particular, |toj| 2 has integral 1, and the Fourier coefficient (\mj\ 2) f(lp) vanishes if 
J # 0. This is equivalent to the average of |mj(f )| 2 over {£ , f +27r/p, . . . , £+27r(p-l)/p} 
being identically 1. 

The same vanishing is true of the Fourier coefficients of the cross terms m^my, and 
for those it also holds when I = 0, Thus, the average of m,-(£)m,v(£) over + 
27r/p, . . . , f + 2ir(p — l)/p} vanishes identically. Hence, the conditions on the filters 
are equivalent to the unitarity of the matrix 

/ mo(0 + ... + \ 

But then ££j \m k (Z)\ 2 = 1 for all £. Thus F$F 0 + ••• + F^F^ is unitarily 
equivalent to multiplication by 1 in L 2 (-ir,ir), proving (4). □ 

With this proposition we can decompose I 2 into mutually orthogonal subspaces 
Wo J_ ••• J_ where = ^(Z 2 ) for i = 0 p - 1. The map # finds 
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the coordinates of a vector with respect to an orthonormal basis of W>. Since each 
p.yyi — Fi{l 2 ) is another copy of I 2 , there is nothing to prevent us from reapplying the 
filter convolutions recursively. At the mth stage, we obtain I 2 = W™ ± ■■■ ± W£k_^, 
where = F* x . . . F^F nm . . . F ni (I 2 ) and rim... n x is the radix-p representation of 
n. The map F^ ...F ni transforms into standard coordinates in W™. For convenience, 
we will introduce the notations F™= F Um ... F ni , and F™* = F* J ... F* m . 

The subspaces W™ form a p-ary tree. Every node W™ is a parent with p daughters 
pjrm+i ? . . . t # The root of the tree is the original space I 2 , which we may label 

for consistency. Call the whole tree W. 

Now fix m and suppose w belongs to W™, where 0 < n < p m - 1, and F™w = e k is 
the elementary sequence with 1 in the fcth position and O's elsewhere. The collection 
of all such w forms an orthonormal basis of I 2 with some remarkable properties. In 
particular, if p = 2 and the filters F 0 and Fi are taken as low-pass and high-pass 

quadrature mirror filters, respectively, then the spaces Wg 1 , W 2 ™-i 3X6 311 the 

subbands at level m. These have been used for a long time in digital signal processing 
and compression. In an earlier paper we described experiments with an algorithm for 
choosing m so as to reduce the bit rate of digitized acoustic signal transmission. This 
produced good signal quality a.t rather low bit rates. 

The tree contains other orthogonal bases of W§. In fact, it forms a library of bases 
which may be adapted to classes of functions. The tree structure allows the library to 
be searched efficiently for the extremum of any additive functional. 

To every node in W we associate the subtree of all its descendants. Define a graph 
to be any subset of the nodes of W with the property that the union of the associated 
subtrees is disjoint and contains a complete level W 0 m , . . . , W™_j for some m. The 
singleton {W§} is a graph, for example, with m = 0. The following may be called the 
graph theorem. 

Theorem. Every graph corresponds to a decomposition of I 2 into a Suite direct sum. 

Proof. Every graph is a finite set, of cardinality no more than p m for the m in the 
' definition. Fix a graph, and suppose that and W™> are subspaces corresponding 
to two nodes. Without loss, suppose that mi < m 2 . Then W™* is contained in a 
subspace W™ 1 for some n # n\. Since the subspaces at a given level are orthogonal, 
we conclude that W™* ± W£> . 

To show that the decomposition is complete, observe that a node contains the sum 
of its daughters. By induction, it contains the sum of all of the nodes in its subtree. 
Hence a graph contains the sum of all the subspaces at some level m. But this sum is 
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aJlofZ 2 . □ 

Theorem. Graphs are in one-to-one correspondence with Unite disjoint covers of [0, 1 ) 
by p-adic intervals i£* = p~ m [n, n + 1), n = 0, 1, . . . ,p m - 1. 

Proof. The correspondence is evidently W™ i£\ The subtree associated to W™ 
corresponds to all j>adic subintervals of i£\ The details are left to the reader. □ 

Analytic properties of graphs: continuous wave packets. Each filter Fj (and 

its adjoint Ff) maps the class of exponentially decreasing sequences to itself. Likewise, 

the projections F™*F™ preserve that class. In practice, we shall consider only finite 

sequences in I 2 . For actual computations the filters must be finitely supported as well. 

Convolution with such filters preserves the property of finite support. Let the support 

width of the filters be r, and let be the maximum width of any vector of the form 

*ii • F j m ( e *)* Tlien z o = 1 and Zm+i = pz^ + r - p. By induction, we see that 
2m=P m + (p m -l)(r-p). 

Coifman and Meyer [CM] have observed that the basis elements F™*e k are related 
to wave packets over IL A slightly generalized paraphrase of their construction follows. 
Many of the basic facts used were proved by Daubechies in [Dj. 

Let w be a function defined by w{$) = IJJli toq(£/p0* w kere m o is the analytic 
function defined by F 0 * as above. Then w has mass 1, decreases rapidly, and is H51der 
continuous, as proved in [D]. If mo is a trigonometric polynomial of degree r, then 
w is supported in the interval [-r,r]. Arranging that w has r continuous derivatives 
requires m 0 with degree at most O(r). See [D] for a discussion of the constant in this 
relation for p = 2. Put w§ = to, and define the family of wave packets recursively by 
the formula w£+*.(t) = E-co U (*)*< (?* - 0- This produces one function w™ for each 
pair (to, n), where m = 0,1,... and n = 0, 1, . . . ,p m - 1. 

We can renormalize the wave packets to a fixed scale p L . Write 

= p {L - m)/2 w^{p^ m t - k). 

• Then w£ Q k is a collection of orthonormal functions of mass 1, concentrated in intervals 
of size 0{p~ L ). This makes them suitable for sampling continuous functions. Let x{t) 
be any continuous function, and put 

sg(fc) = (x. w^ k ) = f x{t)v>l{p L t - k) dt. 

«/— oc 

We may use s§(&) as a representative value of x(t) in the interval ifc = p~ L [k* k + 1). 
The closeness of the approximation to values of x depends, of course, on the smoothness 
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of x. Suppose that x is Holder continuous with exponent e. Then if t Q is any point in 
Jjf , we have 

|*(to) - = I / (*(*>) " «(*)) - *) *l = 0(P~ <L ). 

We can also take advantage of differentiability of x if we construct tug with vanish- 
ing moments. Given d vanishing moments and d derivatives of x, the approximation 
improves to |z(fa) - «g(*)| = 0(p- dL ). 

The map x sends I 2 (R) to i 2 , and pulls back the orthonormal bases of l 2 con- 
structed in the last section. To see this, define s™(fc) = (x,u;£ mtfc ). By interchanging 
the order of recurrence relation and inner product, we obtain the formula = F n s o- 
Thus, the coordinates sJT(fc) are coefficients with respect to an orthonormal basis of 

The resulting subspaces of I? (R) form a finer type of multiresolution decomposition 
than that of Mallat [Ma]. The coordinates s£{k) are rapidly computable. They contain 
a mixture of location and frequency information about x. . 

Ordering the basis elements. The parameters n,m,k,L in w% <mJi have a natural 
interpretation as frequency, scale, position, and resolution, respectively. However, n is 
not monotonic with frequency, because our construction yields wave packets in the so- 
called Paley (natural, or p-adic) ordering. The following results show how to permute 
n h-» n' into a frequency-based ordering. 

Theorem. We can choose rapidly decreasing filters F 0 F p - 1 such that v>{" tmJt 

is concentrated near the interval l£~ m , and t/>£ m , t is concentrated near the interval 
iJJ» , where n »-» n' is a permutation of the integers. 

Proof. The first part is evident. For any family of exponentially decreasing filters, 
tag decreases exponentially away from [0,1). wfr <m , k is its dilate and translate to the 
interval ijf~ m . Likewise, v)%,,m,k has the same concentration as t£>o,m,fc> since 3,11 the 
filters Fi are uniformly exponentially decreasing. 

The second part follows from the Fourier transform of the recurrence relation: 

*5g (e ) = (p- 1 £ /jwe-**'* j kwp) = p-smm 

where m,- is the multiplier defined above. Recall that l m i(0| 2 = 1 and that 
mo(0) = 1. Thus, the periodic functions \mj\ 2 form a partition of unity into p functions, 
with 0 being in the support of mo alone. 
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Now suppose for simplicity that we have chosen filters in such a way that \mj(£)\ = 
SibL-oo X± f 2flr&). Such rrij may be approximated in L 2 (— ?r f 7r) as closely as 

we like by multipliers arising from exponentially decreasing filters. In this simple case, 
it is immediate that = mo{€/p)\(- ViW ) is the characteristic function of (-7r,7r), 

so that t&(£o,o k *be characteristic function of (-irp L ,irp L ). Likewise, wfi 0 is the 
characteristic function of vp^i^j - U irp^tfj + 1). Prom the recurrence 
relation, we see that t&£ mf0 will be the characteristic function of the union of the 
intervals ±xji L ~ in ]p! ^n' + 1), where n h+ n' is a permutation. These intervals cover 
J^i—ir, 7r) as n = 0, - . . ,p m - 1. The permutation nwn'is given by the recurrence 
relation 



~' -r n i ( . -w f n 'P + 3i if n' is even. 

U'p + fe-ll-i, if n' is odd. 



Write nj for the jth digit of n in radix p, numbering from the least significant. Set 
rim = 0 if n has fewer than m digits. Then the recurrence relation implies that 
nj = ir(n£ +1 ,n£) f where 



, x / y 5 if x is 

I p — l — y, it x is 



even, 
odd.. 



For each value of the first variable, tt is a permutation of the set {0, ... ,p - 1} in the 
second variable. Thus the map n' *-* n and its inverse n h n' are permutations of the 
integers. It is not hard to see that these are permutations of order 2 if p happens to be 
odd. Otherwise they have infinite order, as may be seen by considering an increasing 
sequence of integers n' all of which have only odd digits in radix p. □ 

Corollary. With filters -Fb, * * . , Fp_i chosen as above, we can modify the recurrence 
relation for ^ such that w^ m k is concentrated near the interval 2JJ*. 

Proof. Simply reorder the functions w™ by using the alternative recurrence relation: 



w m+i , t) _ f Ejb fj{k)v>nipt - *)* if n is even, 
I fp-i-j(k)wZ(pt - A), if n is odd. 



Since we are enforcing n = n' at each level m, we are composing with the permutation 
defined above. Of course, this algorithm has complexity identical to the original. □ 

Periodic filters and bases for R d . A sampled periodic function may be represented 
as a vector in R d for some d. In this case let p be any factor of d. Introduce as filters 
a family of p vectors {/« 6 R d : i = 0 p - 1}. These are obviously suinmable. 



SUBSTITUTE SHEET 



WO 91/18361 



PCT/US91/03504 



- 35 - 

n-7 

Suppose in addition that they are orthogonal as periodic discrete functions, i.e., that 
Et=i fi(™)fj(™> + kp mod d) = 6^6* 

Let the associated convolution operators be {F 0 , . . . defined as above by 

d 

F i: IL d -> K d/p , Fiv(k) = + ph mod for & = 1, 2, ... , d/p, 

m=l * 
d/p _ 

F* ; R d fr R d , F?v(m) = U{m +pk mod d)v(k) y for m = 1, 2, . . . , d. 

The reduction modulo d is intentionally emphasized. These operators satisfy conditions 
similar to those of aperiodic filters: 

Proposition. 

(1) FiF; = 0, ifi^i, 

(2) FiFt = I d/P 

(3) F*Fi is a rani d/p orthogonal projection on R d , and for i j the ranges of 
F*Fi and FfFj are orthogonal, 

(4) F$F 0 + •-.- + F^F^x = I d 
where Id is the identity on R d . 

Proof. The proof is nearly identical with the one in the aperiodic case. □ 

The decomposition suggested by equation (4) may be recursively applied to the p 
subspaces R d/p by using additional filter families. For d = pi * . .pL and 0 < n < d, 

we have a unique representation n = n\ + U2P\ + n$p2Pi H h klPl-i • * - Pit where 

0 < rii < p^ This defines a one-to-one correspondence between {0, . . . , d - 1} and an 
index set of L-tuples I = { (ni,.. . ,n^) : 0 < n t - <p*}. We can construct a basis of R d 
whose elements are indexed by I. For n = (ni, . . . , nj,) G J, define F£ = . . . F^ , 
where is a family of pi periodic filters. Then F£*F£ is an orthogonal projection 
onto a 1-dimensional subspace of R d . This is shown by induction on the rank in (3). 
Now let W% be the range of this projection. The collection {u n — F^*l n G 1} 
of standard basis vectors of W% will be an orthonormal basis of R d t and the map 
F£ : R d — ► R gives the component in the direction. 

As before, we are not limited to the basis defined by the index set I. Products of 
fewer than L filters form orthogonal projections onto a tree of subspaces of R d . A node 
arising from a product of m filters will correspond to the subspace W™ = F%*F™H d > 
where n = nH 1- n^Pm-i • • • Pi indexes a composition of m filters. The tree will 
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be nonhomogeneous in general, although all nodes i levels from the root will have the 
same number p f of daughters. Define a nonhomogeneons graph as a finite union of 
nodes whose associated subtrees form a disjoint cover of some level m < L. A graph 
theorem holds for this tree of subspaces as well. It and its corollary may be stated as 
follows: 

Theorem. Every nonhomogeneons graph corresponds to an orthogonal decomposition 
ofR d . D 

Corollary. Graphs are in one-to-one correspondence with Suite disjoint covers of [0.1) 
by intervals of the form I? = fa . ..^[n, n + 1). □ 

Any permutation of the prime factors of d gives a (possibly different) basis. 

Smooth filters. Some filter sequences have a smoothness property: 

Definition. A snmmable sequence f is a smooth Biter (of rank p) if there is a nonzero 
solution <f> in X^R) n £ 2 (R) n C°°(R) to the functional equation 

<f>(x) = p 1 ' 2 J2 f(m)<f>(px + m). 

m 

A filter will be said to have smoothness degree r if it satisfies this definition with 
C°° replaced by C. Daubechies has shown in [D] that finitely supported filters of any 
degree of smoothness may be constructed in the case p = 2. An obvious consequence 
is that smooth filters exist in the case p = 2«. For arbitrary p, we may construct a 
filter family as above subject to additional constraints. 

A continuous L 2 solution to the functional equation (3) always exists for a sequence 
/ satisfying the three conditions at the top of this article. Its Fourier transform may 
be constructed by iteration: 

PC 

fa) = kO)l[m(Z/p k ). 

where m(f ) = p" 1 / 2 £ fc f(k)e- ik * is the multiplier corresponding to the filter convo- 
lution in the integral equation. If <f> is nonzero, then ^(0) # 0. so it may be assumed 
that #(0) = 1. Now the sequence {f{k)\k\ e } converges absolutely, so m(£) is Holder 
continuous of degree e. But also. m(0) = p 1 / 2 £ & f{k) = 1. so that for f near 0 the 
estimate |m(f ) - 1| < C|f | e holds. This implies that the infinite product converges. 
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Appendix m 
Nonstandard Matrix Multiplication 

Wave packets. Define wave packets over I 2 in the usual way. For a pair P = {p* }, Q = 
{Qi} of quadrature mirror filters (QMFs) satisfying the orthogonality and decay con- 
ditions stated in [CW], there is a unique solution to the functional equation 

*(t) = V5£>*(2t-j). 

Put w = ti/o.0,0 = & and define recursively 

^2n,o.o(t) = ^2^^,0,0(2^ - j), 
i€Z 

t^2fH-i,o,o(<) = y/2^qjW nS w{2t - 3). 
i€Z 

Then set w nmk {t) = 2 m / 2 ™ n00 (2 m t - fc). Write W(R) = {w nmfc : n,m, k G Z} for the 
collection of functions so defined, which we shall call wave packets. 

The quadrature mirror filters P, Q may be chosen so that W(R) is dense in many 
common function spaces. With the minimal hypotheses of [CW], W(R) will be dense 
in £ 2 (R). Using the Haar filters P = {1/V5,1/V2},G = {l/\/2, produces 
W(R) which is dense in ^(R) for 1 < p < 00. Longer filters can generate smoother 
wave packets, so we can also produce dense subsets of Sobolev spaces, etc. 

Basis subsets. Define a basis subset a of the set of indices {(n,m,fc) € Z 3 } to be 
any subcollection with the property that {t// n mfc : fa m, /:) € <x} is a Hilbert basis for 
JD 2 (R). We characterize basis subsets in [Wl]. Abusing notation, we shall also, refer to 
the collection of wave packets {w nTnk : (n,m, /c) 6 a} as a basis subset. 

Since I? n IP is dense in IP for 1 < p < 00, with certain QMFs a basis subset will 
also be a basis for IP. Likewise, for nice enough QMFs, it will be a Hilbert basis for 
the various Sobolev spaces. 

Since £ 2 (R) ® L 2 (R) is dense in L 2 (R 2 ). the collection of vectors {wx ® wy : wx € 
W(X),wy e W(y)} is dense in the space of Hilbert-Schmidt operators. Call a C Z c a 



es% inf*TlTI IXC CUPPT 



WO 91/18361 



PCT/US91/03504 



- 38 a - 

m-2 

basis subset if the collection {w nx m x k x ®w nr m y fcr : { n x*™>x*kxjny,my, ky) e a} 
forms a Hilbert basis. Such two-dimensional basis subsets are characterized in [W2]. 

Ordering wave packets. Wave packets w nm k can be totally ordered. We say that 
w < w* if (m, n, k) < (m', n', A/). The triplets are compared lexicographically, counting 
the scale parameter m as most significant. 

Tensor products of wave packets inherit this total order. Write wx = Wnxmxkx* 
etc. Then we will say that wx ®wy < w' x ® w Y if w x < w x * or else if w x = w' x but 
wy < xv'y. This is equivalent to 

(Tnx,nx,kx,my,nY,ky) < (mx,nx,kx,my y ny,ky), 

comparing lexicographically from left to right. 

Define the adjoint order <* by exchanging X and Y indices, namely w x ® wy <* 
w f x ® Wy if and only if wy ® w x <* ttfy ® w' x * This is also a total order. 

Projections. Let W l denote the space of bounded sequences indexed by the three^ 
wave packet indices n, m, k. With the ordering above, we obtain a natural isomorphism 
between l°° and W 1 . There is also a natural injection J 1 : L 2 (R) W 1 given by 
Cnnt = {v,w nmk ), for v € L 2 {R) and w nm k € W(R). If a is a basis subset, then 
the composition J* of J 1 with projection onto the subsequences indexed by a is also 
injective. J* is an isomorphism of L 2 (R) onto l 2 (<r) y which is defined to be the square 
summable sequences of W 1 whose indices belong to <j. 
We also have a map R 1 : W 1 — > L 2 (R) defined by 

R l c{t) = ^2 CnmkWnmkit). 
(n,m,fc)€Z* 

This map is defined and bounded on the closed subspace of W 1 isomorphic to I 2 under 
the natural isomorphism mentioned above. In particular. R 1 is defined and bounded 
on the range of J* for every basis subset a. The related restriction R l ff : W 1 -> 
L 2 (R) defined by R l a c{t) = E<n t mjb)e* CnmkW n mk(t) is a left inverse for J 1 and J*. In 
addition, J 1 ^ is a projection of W 1 . Likewise, if £ f Oi = 1 and R\. is one of the 
above maps for each i, then J 1 a;i£, is also a projection of W 1 . It is an orthogonal 
projection on any finite subset of W 1 . 

Similarly, writing W 2 for W 1 x W 1 . the ordering of tensor products gives a natu- 
ral isomorphism between l°° and W 2 . The space L 2 (R 2 ). i.e.. the Hilbert-Schmidt 
operators, inject into this sequence space W 2 in the obvious way, namely M 
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{M % w nxmx t x ® tWnym r Jby)- Call this injection J 2 . If a is a basis subset of W 2 , 
then the composition J 2 of J 2 with projection onto subsequences indexed by a is also 
injective. is an isomorphism of L 2 (R 2 ) onto I 2 (a), the square summable sequences 
of W 2 whose indices belong to a. 

The map R 2 : W 2 -» L 2 (R 2 ) given by R 2 c(x,y) = Y,cxYV>x(x)w Y (yl is bounded 
on that subset of W 2 naturally isomorphic to I 2 . In particular, it is bounded on the 
range of for every basis subset a. 

We may also define the restrictions JZ 2 of R 2 to subsequences indexed by o\ defined 
by R 2 c{x % y) = S( WJC w ) €<7 cjrYWJc(x)™y(j/). There is one for each basis subset a of 
W 2 . Then R 2 is a left inverse of J 2 and and JPR 2 is a projection of W 2 . As before. 

St = 1 a* is a basis subset for each i, then J 2 ^ i2 2 . is also a projection of 
W 2 . It is an orthogonal projection on any finite subset of W 2 . 

Applying operators to vectors. For definiteness, let X and Y be two named copies 
of R. Let v 6 L 2 (X) be a vector, whose coordinates with respect to wave packets form 
the sequence J l v = {{t/, w x ) : wx € W(X)}. 

Let M : L 2 (X) L 2 (y) be a Hilbert-Schmidt operator. Its matrix coefficients 
with respect to the complete set of tensor products of wave packets form the sequence 
J*M = {(M,w x ®wy):w x e W{X),w Y € W{Y)}. We obtain the identity 

(Mv, wy) = {M,w x ®wy) (v, w x ) 

This identity generalizes to a linear action of W 2 on W 1 defined by 

C{v)nmk = ^ Cnmkn'm'k' ^n'm'fc'. 
(n'm'Jb') 

Now, images of operators form a proper submanifold of W 2 . Likewise, images of vectors 
form a submanifold W 1 . We can lift the action of M on v to these larger spaces via 
. the commutative diagram 

JIM N 

w 1 ► w 1 

L 2 (R) ► L 2 (R) 

M 

The significance of this lift is that by a suitable choice of a we can reduce the complexity 
of the map J^M, and therefore the complexity of the operator application. 
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Composing operators. Let X,Y,Z be three named copies of R. Suppose that 
M : L 2 (X) -* L 2 (Y) and N : L 2 (Y) L 2 (Z) are Hilbert-Schmidt operators. We 
have the identity 

This generalizes to an action of W 2 on W 2 , which is defined by the formula 

Cifynmkn'm'k' = ^ dnmkn"m"k f 'C n "Tn''k''ii<Tn'k' » 
n"m"Jfc" 

where c and d are sequences in W 2 . Using J 2 , we can lift multiplication by N to an 
action on these larger spaces via the commutative diagram 

W 2 W 2 
J>] I* 
L 2 (R 2 ) _> L 2 (R 2 ) 

Again, by a suitable choice of a the complexity of the operation may be reduced to 
below that of ordinary operator composition. 

Operation counts: transforming a vector. Suppose that M is a non-sparse opera- 
tor of rank r. Ordinary multiplication of a vector by M takes at least 0(r 2 ) operations, 
with the minimum achievable only by representing M as a matrix with respect to the 
bases of its r-dimensional domain and range. 

On the other hand, the injection J 2 will require 0(r 2 [logr] 2 ) operations- and each 
of J 1 and R 1 require O(rlogr) operations. For a fixed basis subset a of W 2 , the 
application of J%M to J l v requires at most #\J%M\ operations, where #|Z7| denotes 
the number of nonzero coefficients in U. We may choose our wavelet library so that 
#\J 2 M\ = 0(r 2 ). Thus the multiplication method described above costs an initial 
investment of 0(r 2 [log r] 2 ), plus at most an additional 0(r 2 ) per right-hand side; Thus 
the method has asymptotic complexity 0(r 2 ) per vector in its exact form, as expected 
for what is essentially multiplication by a conjugated matrix. 

We can obtain lower complexity if we take into account the finite accuracy of our 
calculation. Given a fixed matrix of coefficients C t write Cs for the same matrix with 
all coefficients set to 0 whose absolute values are less than 6. By the continuity of the 
Hilbert-Schmidt norm, for every e > 0 there is a 6 > 0 such that \\C-Cs\\hs < e. Given 
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M and e as well as a library of wave packets, we can choose a basis subset a C W 2 
so as to minimize #|(J^Af) tf |. The choice algorithm has complexity 0(r 2 [logr] 2 ), as 
shown in [W2]. For a certain class of operators, there is a library of wave packets such 
that for every fixed 6 > 0 we have 

( S ) #l(J!W«l = 0(rkgr), 

with the constant depending, of course, on 6. We will characterize this class, give 
examples of members, and find useful sufficient conditions for membership in it. For the 
moment, call this class with property S the spaim&able ffilbert-Schmidt operators S. 
By the estimate above, finite-precision multiplication by sparsifiable rank-r operators 
has asymptotic complexity O(rlogr). 

Operation counts: composing two operators. Suppose that M and N are rank-r 
operators. Standard multiplication of N and M has complexity 0(r 3 ). The complexity 
of injecting N and M into W 2 is 0(r 2 [logr] 2 ). The action of J$N on PM has com- 
plexity 0(I^ mJfc #|4iV^ : (n Y ,m Y ,ky) = (n,m, J^Mxy : (ny.my,jL v ) = 
(n.m,fc)|). The second factor is a constant rlogr, while the first when summed over 
all nmk is exactly #|J^JV|. Thus the complexity of the nonstandard multiplication 
algorithm, including the conjugation into the basis set a, is 0(#|J 2 iV| rlogr). Since 
the first factor is r 2 in general, the complexity of the exact algorithm is 0(r 3 logr) for 
generic matrices, reflecting the extra cost of conjugating into the basis set a. 

For the approximate algorithm, the complexity is 0(#|(J|JV) 5 | rlogr). For the 
sparsifiable matrices, this can be reduced by a suitable choice of a to a complexity 
of 0(r 2 [logr] 2 ) for the complete algorithm. Since choosing a and evaluating J 2 each 
have this complexity, it is not possible to do any better by this method. 
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Appendix IV 
Entropy of a Vector Relative to a Decomposition 

Let v e H \\v\\ = 1 and assume 

an orthogonal direct sum. We define 

eHv,{S i }) = -J2\\vi\\ 2 £u\\v i f 

as a measure of distance between v and the orthogonal decomposition. 

e 2 is characterized by the Shannon equation which is a version of Pythagoras' the- 
orem. 

Let 

E x and Hj give orthogonal decomposition 2T + = J^IP jj_ = £ JTy. Then 

e'M^M) = ^M* + ,ii-}+K||V (j-^fir}) -HMIV 

This is Shannon's equation for entropy (if we interpret as in quantum mechanics 
ll-Pff+^ll 2 as the "probability" of v to be in the subspace JT + ). 

This equation enables us to search for a smallest entropy space decomposition of a 
given vector. We need the following E = H\ © U2. 

#1=0^^ = ©£#'. 

H\ has two decompositions in H % or if J . 
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Lemma 1. Let v € H with \\v\\ and 



vi = P El v v[ = Vl 



INI 

Assume also that e 2 ^, {S*}) < e 2 ^, {K*}) then, ifH 2 we have 

C l (v t {H i i IP})<^{v,{K^L i }) 

Proof. By Shannon's equation 

e 2 {v, {IT, V}) = e 2 (t/, {H U H % }) + ||t*|| V(i4, {iP}) 
+ H«*HV(t4.{^}) 

< 6»( V| {J? lt ff 2 }) + IKHVK, {^}) + 

= e 2 K{^ i ^*})- 

Corollary. Assume e 2 (vj, {H*}) is the smallest entropy obtained for some collection 
of decompositins of Hi and similarly, e^{v f 2 , {&}) is minimal. Then e*{v\ {W.lJ}) is 
minimal for the direct sum of these collections. 

We consider the following generic example on L 2 (R+). 

Let I denote a dyadic interval of the form (2 j k,2 j {k + 1)] , j > 0 k > 0, and {I a } a 
disjoint cover over (0, oo) consisting of dyadic intervals. We let Hj a = £ 2 (I Q ) on which 
we chose an orthonormal basis {e£* fc } a fixed (say trig polynomials exp(2m^-)xi at ( x )0 
and consider {e£ fc } as an orthonormal basis of L 2 (R+). Thus 

L 2 (R+ = ][X=£5> a , fc } 

a Jb 

Given a vector v we wish to find I a such that e 2 (v, {e at *}) is minimal. In order 
to find I a we use a stopping time argument. Starting with intervals of length one 
h = + 1]. We pick a dyadic interval of length two which contains halves hl 2 of 
length one, i.e. J = ii U I2. We compart 

£*(VXJA4}) with f{vxjM l }Wf}) 

and pick the basis given the smallest entropy leading to a cover of £ 2 (R) by intervals 
of length one and two. We now consider dyadic intervals K of length 4 and compare 

e*{vXK{ef}) with ^(vxKiie 1 ^}) 
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where I a form a cover of K by dyadic intervals of length one or two selected previously 
to minimize e 2 on each half of K. 

(If the vector function v has bounded support we restrict our attention only to 
dyadic intervals contained in the smallest dyadic interval containing the support of v) 
and continue this procedure up to this largest scale. We claim that the final partition 
J a and corresponding basis provides .the minimal entropy decomposition. In fact, this 
is an immediate consequence of Lemma 1 which shows that given the optimal minimum 
entropy partition any refinement corresponds to worse entropy. 
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Appendix V 
Higher-Dimensional Best Basis Selection 

Introduction. We introduce a method of coding by orthogonal functions which may 
be used to compress digitized pictures or sequences of pictures, matrices and linear 
operators, and general sampled functions of several variables. The method selects a 
most efficient orthogonal representation from among a large number of possibilities. 
The efficiency functional need only be additive across direct sum decompositions. We 
present a description of the method for pictures, namely functions of two variables, 
using Shannon entropy as the efficiency functional, and mean-square deviation as the 
error criterion. 

Best basis method. In Appendix H is developed a method for generating a library 
of orthogonal vectors in R n (for large n) together with a notion of admissible subsets 
of these vectors. Admissible subsets form orthonormal bases of wavelet-packets, which 
because of their homogeneous tree structure may be rapidly searched for functional 
extrema. We can use a family of orthonormal vectors well suited to representing 
functions of 2 variables. These are products of quadrature mirror filters, as defined 
below: 

Let {p k },{qk} belong to I 1 , and define two decimating convolution operators P : 
J 2 -/ 2 ,*?:* 2 -/ 2 as follows: 

°o oo 

P /*= 51 Pjfj+2ki Qfk = ?i/i+2fc- 
3——0O j——oo 

■ P and Q are called quadrature mirror filters if they satisfy an orthogonality condition: 

PQ* = QP* = 0. 

where P m denotes the adjoint of P, and Q* the adjoint of Q. They are further called 
perfect reconstruction filters if they satisfy the condition 

P*P + Q*Q = I, 
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where I is the identity operator. These conditions translate to restrictions on the 
sequences {p*}, Let mo, mi be (bounded) functions defined by 

Then P, Q are quadrature mirror filters if and only if the matrix below is unitary for 
all£: 

(mo(0 rno(t + *)\ 

This fact is proved in [D]. 

Now we can define a number of orthogonal 2-dimensional convolution-decimation 
filters in terms of P and Q. Four of them are simply tensor products of the pair of 
quadrature mirror filters, as in the construction of 2-dimensional wavelets of Meyer 
[M]. 



F 0 d = P S> -P, F 0 V(X, y ) = £ J )P2x+iP2y+j 

F 2 = Q ® P, F 2 v{x r y) = 53 i )92x+iP2»+i 
JF3 " <9 ® <2> F z v{x, y) = £ «(*.i)P2x+tP2y + j 



There are also pairs of extensions of one dimensional niters: 

Py=I®P, Pyv(x,y) ^^2v{i,j)6 x ,iP2y+j = J^v(x,j)p 2y+j ^ 

*j i 

Q Y = I®Qy Qyv{x, y) = 53 v & i) 6 *>itov+j = 51 v (*» 

*.i i 

Px = P®/, y ) = 53 V V> i )P»*+*6vj = 51 ^)P2«+* 

Q X = Q®I, Qxv(x, y) = 53 «(«. i)ftx+f ffyj = 5] y)92x+« 
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These convolution-decimations have the following adjoint: 



s: 



F 3«(^.J) =J2 V ^ 3)P2i+xP2j+y 



Q Y v(x t y) = ^u(i,j)5 !e , i92i+t , = J2 v M)toj+v 
P x v(x,y) = J>(t, jJfti+.V,. = J3«(t,y) P2i+B 



The orthogonality relations for this collection are as follows: 

i = f;f 0 © f;f! © fjf 2 © f;f 3 

PxPx = PyPy = QxQx = QyQy = J 
PxQx = QxP x = PyQy = QyPy = 0 
J" = P x Px © <9*Qa: = PpPy © QyQy 

By a "picture" we will mean any function 5 = S(x,y) e l 2 (Z 2 ). The space 
l 2 (Z 2 ) of pictures may be decomposed into a partially ordered set W of subspaces 
W{nx t n Y ,m x .mY), where m x > 0, my > 0, 0 < n x < 2 mx . and 0 < n Y < 2 mi ". 
These are the images of orthogonal projections composed of products of convolution- 
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decimations. Put W(0, 0, 0, 0) = / 2 , and define recursively 

W(2n x + i, 2ny + j, m x + 1, my + 1) = ^t+j-^t+i^fnjir, ny , m x , my), 
TT(2nx»ny,mx + l,my) = P^PjifPrfn^ny^jcmy), 
^(2*1^ + l 1 ny,mjr +1-, my) = Q^^x^y^x^y), 
PP(nx,2ray,mx,my + 1) = PyiV^njcny, mjcmy), 

W(njt,2ny + l,TOjc»my + 1) = Q x Q X W(n x ,ny,m Xy my). 

These subspaces may be partially ordered by a relation which we define recursively as 
well. We say W is a precursor of W f (write W •< W) if they are equal or if W = G* GW 
for a convolution-decimation G in the set {F^FuF^Fz^Px^Py^Qx^ Qy}- We also 
say that W X W if there is a finite sequence Vi, . . . , V n of subspaces in W such that 
W -<Vi •< - < - -<V n W. This is well defined, since each application of G*G increases 
at least one of the indices nix °r my. 

While { W, -<} is not a tree, it may be made into a tree if we select a subset of 
the relation <. We will say that W = W(nx i nY,mxyTny) is a principal precursor of 
W = W(n , x ^nY 9 rn/ x ,my) (and write W -< W f ) if one of the following holds: 

(1) my =m*, and W = <7*GW for Ge {F^F u F 2 ,F^P x ,Py,Qx,Qy}, or 

(2) my < m X n and W = <7*GW for G € {P*, Q*}, or 

(3) my > m^, and W - <?*GW for G £ {Py, Qy}. 

Further, we will say that W -< W if there is a finite sequence Vb, . . . , V n of subspaces 
in W with W X V 0 -< • -< V n •< W. The relation ^ is well defined, since it is a 
subrelation of ^, and it is not hard to see that every subspace W € W has a unique 
first principal precursor. Therefore, {W, -<} forms a (nonhomogeneous) tree, with 
17(0,0,0,0) at its root. 

Subspaces of a single principal precursor W € W will be called its children. By the 
orthogonality condition, 

(F) W = F£F 0 W 0 FfFiW 0 F^F 2 W © F£F 3 W 

(X) =P5cPxWeQ5cQxW 
(Y) ^P^fyT^eQyQyW. 

The right hand side contains all the children of W+ divided into the groups "F." "X." 
and "Y." Each labelled group of children provides a one-step orthogonal decomposition 
of W. and in general we will have three subsets of the children to choose from. 
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The coordinates with respect to the standard basis of W(n x , n Y , m Xt m Y ) form the 
sequence G x . . . G m W{0, 0, 0, 0), where m = max{m X) m Y }, and the particular filters 
G 1 ...G m are determined uniquely by n x and n Y . This is described in Appendix 
H, attached hereto. Therefore we can express in standard coordinates the orthogo- 
nal projections of W(0, 0,0,0) onto the complete tree of subspaces W by recursively 
convolving and decimating with the filters. 

Relation with one-dimensional wave packets. Let w nmk be a one-dimensional 
wave packet at sequency n, scale m and position fc, in the notation of Appensix II. 
Then the element in the (A*,fcy) position of the subspace W(n x ,n Y ,m x .m Y ), at 
the index (a:,y), may be written as w nx , mXtkx (x)w nytmy>ky (y), which is evidently 
the tensor product of two one-dimensional wave packets. This is easily seen from the 
construction of W(n x ,n Yl m x ,m Y ): in the x-direction, there will be a total of m x 
convolution-decimations in the order determined by n x , with the result translated to 
position k Xl and similarly in the y-direction. 

We will use the notation w ® v for the tensor product of two one-dimensional wave 
packets, with the understanding that the second factor depends on the y-coordinate. 
Since the one-dimensional wave packets are themselves a redundant spanning set, their 
tensor products contain a redundancy of bases for Z 2 R 2 . We can search this collection 
of bases efficiently for a best-adapted basis, using any additive measure of information, 
in a maimer only slightly more complicated than for the one dimensional case. 

Selecting a best basis. Let S = S(x, y) be a picture, and let W be a tree of wavelet 
packets. Choose an additive measure of information as described in Appendix II, and 
attribute to each node W(n x ,n Y ,m x ,m Y ) the measure of information contained in 
the coordinates of 5 with respect to the wavelet packets it contains. For example, we 
may use Shannon entropy, 

nw)= j^iogp 2 , 

where p = (S, w nxmxkx ® w nymYky ), andW = W{n x , m x .n Y , m Y ). We will choose 
an arbitrary maximum level in the tree W. and mark all of its nodes as "kept." Pro- 
ceeding up from this level to the root, we will compare H{ W) for a node W of the tree 
W to the minimum of Zw^weF W), Zwwex and Zw*w> €Y 

If H(W) is less, then mark W as u kept r and mark as "not kept" all nodes W with 
W -< W'\ otherwise, markW as "not kept," but attribute to it the minimum of the en- 
tropies of its children. When this procedure terminates at the root, the nodes marked 
"kept" will comprise an orthogonal collection of wavelet packets. 
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It is not necessary to mark all descendants of a "kept" parent as not kept. The 
complexity of the search algorithm is 0{n log n) if we never change the status of de- 
scendants, but instead take for the orthogonal collection only those nodes marked 
"kept" which have no ancestors marked "kept." These may be listed efficiently by 
indexing the tree in the preorder or depth-first order. 

Error estimates for the best basis. Let H{S) denote the entropy of the picture 
S in the best basis found above. This quantity will be found attributed to node 
W(0, 0, 0, 0) at the end of the search. It is related to the classical Shannon entropy Ho 
by the equation 

H 0 (S) = \\S\\-*H(S) + log\\S\\ 2 

The largest expHo(S) = ||5|| 2 expW(5)/||5|| 2 terms of the wavelet packet expansion 
for S contain essentially all the energy of the original picture. Mean square error 
bounds for specific classes of signals are provided in Appendix IV. 
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CLAIMS ; 

1. A method for encoding and decoding an input signal, 
comprising the steps of: 

applying combinations of dilations and translations of 
a wavelet to the input signal to obtain processed values; 

computing the information costs of the processed 

values ; 

selecting, as encoded signals, an orthogonal group of 
processed values, the selection being dependent on the computed 
information costs; and 

decoding the encoded signals to obtain an output 

signal. 

2. The method as defined by claim 1, wherein said wavelet 
has a plurality of vanishing moments. 

3. The method as defined by claim 1 or 2, further 
comprising transmitting the encoded signals, and receiving the 
transmitted encoded signals before the decoding thereof. 

4. The method as defined by claim 3, further comprising 
storing the encoded signals, and reading the stored encoded 
signals before the decoding thereof. 

5. The method as defined by claim 2, wherein said step of 
applying combinations of dilations and translations of the 
wavelet to the input signal to obtain processed values comprises 
correlating said combinations of dilations and translations of 
the wavelet with the input signal. 

6. The method as defined by claim 2 or 5, wherein 
combinations of dilations and translations of the wavelet are 
designated as wavelet-packets, and wherein the step of applying 
wavelet-packets to the input signal to obtain processed values 
includes: generating a tree of processed values, the tree having 
successive levels obtained by applying to the input signal, for a' 
given level, wavelet-packets which are combinations of the 
wavelet-packets applied at a previous level. 

7. The method as defined by claim 6, wherein the steps of 
computing information costs and selecting an orthogonal group of 
processed values includes performing said computing at a number 
of different levels of said tree, and performing said selecting 
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from among the different levels of the tree. 

8. The method as defined by claim 2 or 7, wherein said 
step of selecting an orthogonal group of processed values 
comprises selecting an orthogonal group having a minimal 
information cost. 

9. The method as defined by claim 8, wherein said step of 
selecting an orthogonal group of processed values includes 
generating encoded signals which represent said processed values 
in conjunction with their respective locations in said tree. 

10. A method for encoding an input signal, comprising the 
steps of: 

selecting a wavelet having a plurality of vanishing 

moments ; 

applying combinations of dilations and translations of 
the wavelet to the input signal to obtain processed values; and 

selecting/ as encoded signals, an orthogonal group of 
processed values. 

11. The method as defined by claim 10, further comprising 
decoding the encoded signals. 

12. The method as defined by claim 10 or 11, further 
comprising transmitting the encoded signals, and receiving the 
transmitted encoded signals before the decoding thereof. 

13. The method as defined by claim 10, wherein said step 
of applying combinations of dilations and translations of the 
wavelet to the input signal to obtain processed values comprises 
correlating said combinations of dilations and translations of 
the wavelet with the input signal. 

14. A method for encoding an input signal, comprising the 
steps of: 

applying combinations of dilations and translations of 
'a wavelet to the input signal to obtain processed values i . 

computing the information costs of the processed 
values; and 

selecting, as encoded signals, an orthogonal group of 
processed values, the selection being dependent on the computed 
information costs. 

15. The method as defined by claim 14, wherein said 
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wavelet has a plurality of vanishing moments. 

16. The method as defined by claim 15 , further comprising 
transmitting the encoded signals, and receiving the transmitted 
encoded signals before the decoding thereof. 

17. The method as defined by claim 15, further comprising 
storing the encoded signals. 

18. The method as defined by claim 15, wherein said step 
of applying combinations of dilations and translations of the 
wavelet to the input signal to obtain processed values comprises 
correlating said combinations of dilations and translations of 
the wavelet with the input signal. 

19. The method as defined by claim 15 or 18, wherein 
combinations of dilations of the wavelet are designated as 
wavelet-packets, and wherein the step of applying wavelet-packets 
to the input signal to obtain processed values includes: 
generating a tree of processed values, the tree having successive 
levels obtained by applying to the input signal, for a given 
level, wavelet-packets which are combinations of the 
wavelet-packets applied at a previous level. 

20. The method as defined by claim 19, wherein the steps 
of computing information costs and selecting an orthogonal group 
of processed values includes performing said computing at a 
number of different levels of said tree, and performing said 
selecting from among the different levels of the tree. 

21. The method as defined by claim 15, wherein said step 
of selecting an orthogonal group of processed values comprises 
selecting an orthogonal group having a minimal information cost. 

22. The method as defined by claim 20, wherein said step 
of selecting an orthogonal group of processed values comprises 
selecting an orthogonal group having a minimal information cost. 

23. The method as defined by claim 22, wherein said step 
of selecting an orthogonal group of processed values includes 
generating encoded signals which represent said processed values 
in conjunction with their respective locations in said tree. 

24. For use in a system which receives an encoded signal 
obtained by: applying combinations of dilations and translations 
of a wavelet having a plurality of vanishing moments to the input 
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signal to obtain processed values; and selecting, as encoded 
signals, an orthogonal group of processed values; a decoding 
method comprising: sequentially applying combinations of 
dilations and translations of a wavelet having a plurality of 
vanishing moments to the encoded signals to decode said encoded 
signals; and outputting the decoded result. 

25. The decoding method as defined by claim 24, wherein the 
encoded signals Include identification of the selected orthogonal 
group of processed values, and further comprising the step of 
determining said identification, and performing the sequential 
decoding procedure in accordance with said identification. 

26. Apparatus for encoding an input signal, comprising: 
means for applying combinations of dilations and 

translations of the wavelet to the input signal to obtain 
processed values; 

means for computing the information costs of the 
processed values; 

means for selecting, as encoded signals, an orthogonal 
group of processed values, the selection being dependent on the 
computed Information costs. 

27. Apparatus as defined by claim 26, wherein said 
wavelet has a plurality of vanishing moments. 

28. Apparatus as defined by claim 27, wherein said means 
for applying combinations of dilations and translations of the 
wavelet to the input signal to obtain processed values comprises 
means for correlating said combinations of dilations and 
translations of the wavelet with the input signal. 

29. Apparatus for encoding an input signal, comprising: 
means for applying combinations of dilations and 

translations of a wavelet having a plurality of vanishing moments 
to the input signal to obtain processed values; and 

means for selecting, as encoded signals, an orthogonal 
group of processed values. 

30. For use in a system which receives an encoded signal 
obtained by: applying combinations of dilations and translations 
of a wavelet having a plurality of vanishing moments to the input 
signal to obtain processed values; and selecting, as encoded 
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signals/ an orthogonal group of processed values; a decoding 
apparatus comprising: means for sequentially applying 
combinations of dilations and translations of a wavelet having a 
plurality of vanishing moments to the encoded signals to decode 
said encoded signals; and means for outputting the decoded 
result • 
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